Apr 21 20:46:52 devstack cinder-volume[72298]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 21 20:46:52 devstack cinder-volume[72298]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 20:46:52 devstack cinder-volume[72298]: we strongly recommend against using it for new projects. Apr 21 20:46:52 devstack cinder-volume[72298]: If you are already using Eventlet, we recommend migrating to a different Apr 21 20:46:52 devstack cinder-volume[72298]: framework. For more detail see Apr 21 20:46:52 devstack cinder-volume[72298]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 20:46:52 devstack cinder-volume[72298]: import eventlet # noqa Apr 21 20:46:54 devstack cinder-volume[72298]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72298) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:46:54 devstack cinder-volume[72298]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72298) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:46:54 devstack cinder-volume[72298]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72298) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:46:54 devstack cinder-volume[72298]: INFO dbcounter [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Registered counter for database cinder Apr 21 20:46:54 devstack cinder-volume[72298]: DEBUG oslo_db.sqlalchemy.engines [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72298) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:46:54 devstack cinder-volume[72298]: DEBUG dbcounter [-] [72298] Writer thread running {{(pid=72298) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:46:54 devstack cinder-volume[72298]: INFO cinder.rpc [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 21 20:46:54 devstack cinder-volume[72298]: INFO cinder.rpc [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 21 20:46:54 devstack cinder-volume[72298]: DEBUG oslo_db.sqlalchemy.engines [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72298) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:46:54 devstack cinder-volume[72298]: INFO cinder.volume.manager [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Determined volume DB was empty at startup. Apr 21 20:46:54 devstack cinder-volume[72298]: DEBUG cinder.volume.manager [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72298) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 21 20:46:54 devstack cinder-volume[72298]: INFO cinder.volume.manager [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 21 20:46:54 devstack cinder-volume[72298]: WARNING stevedore.named [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 21 20:46:54 devstack cinder-volume[72298]: WARNING castellan.key_manager [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:46:54 devstack cinder-volume[72298]: WARNING cinder.keymgr.conf_key_mgr [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:46:54 devstack cinder-volume[72298]: DEBUG cinder.volume.drivers.lvm [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72298) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 21 20:46:54 devstack cinder-volume[72298]: DEBUG oslo_concurrency.processutils [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_concurrency.processutils [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] CMD "cinder-rtstool verify" returned: 0 in 0.273s {{(pid=72298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_db.sqlalchemy.engines [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72298) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:46:55 devstack cinder-volume[72298]: INFO cinder.rpc [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 21 20:46:55 devstack cinder-volume[72298]: INFO cinder.rpc [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 21 20:46:55 devstack cinder-volume[72298]: WARNING stevedore.named [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 21 20:46:55 devstack cinder-volume[72298]: WARNING castellan.key_manager [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:46:55 devstack cinder-volume[72298]: INFO cinder.volume.manager [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_db.sqlalchemy.engines [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72298) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:46:55 devstack cinder-volume[72298]: INFO oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Starting 1 workers Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Started child 72421 {{(pid=72298) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Full set of CONF: {{(pid=72298) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] ******************************************************************************** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Configuration options gathered from: {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] ================================================================================ {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] allow_availability_zone_fallback = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] allow_compression_on_image_upload = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] allowed_direct_url_schemes = [] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] api_rate_limit = True {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] auth_strategy = keystone {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] az_cache_duration = 3600 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_availability_zone = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_host = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_name = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_stats_polling_interval = 60 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backup_api_class = cinder.backup.api.API {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backup_name_template = backup-%s {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backup_use_same_host = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backup_use_temp_snapshot = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] chap_password = **** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] chap_username = {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cinder_internal_tenant_project_id = 70e5832dfbd54fbbab85fcdfe4c605b7 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cinder_internal_tenant_user_id = 2c6cabd9352a41468aa1654eb228d9aa {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cloned_volume_same_az = True {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cluster = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] compression_format = gzip {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] compute_api_class = cinder.compute.nova.API {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] config_dir = [] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] config_source = [] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] control_exchange = openstack {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] debug = True {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] default_availability_zone = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] default_group_type = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] default_volume_type = lvmdriver-1 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] disk_geometry = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72421]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] driver_client_cert = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] driver_client_cert_key = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] driver_data_namespace = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] driver_ssl_cert_path = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] driver_ssl_cert_verify = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] driver_use_ssl = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] enable_force_upload = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] enable_new_services = True {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] enable_unsupported_driver = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] enforce_multipath_for_image_xfer = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] filter_function = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] glance_api_insecure = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] glance_api_servers = ['http://192.168.122.130/image'] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] glance_api_ssl_compression = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] glance_ca_certificates_file = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] glance_catalog_info = image:glance:publicURL {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] glance_certfile = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] glance_keyfile = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] glance_num_retries = 3 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] glance_request_timeout = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] goodness_function = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] graceful_shutdown_timeout = 5 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] group_api_class = cinder.group.api.API {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] host = devstack {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] image_compress_on_upload = True {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] image_conversion_address_space_limit = 1 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] image_conversion_cpu_limit = 60 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] image_conversion_disable = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] image_upload_use_cinder_backend = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] image_upload_use_internal_tenant = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] image_volume_cache_enabled = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] image_volume_cache_max_count = 0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] image_volume_cache_max_size_gb = 0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] init_host_max_objects_retrieval = 0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] instance_format = [instance: %(uuid)s] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] iscsi_target_flags = {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] iscsi_write_cache = on {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] iser_helper = tgtadm {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] iser_ip_address = 192.168.122.130 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] iser_port = 3260 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] log_color = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] log_config_append = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] log_dir = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] log_file = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] log_options = True {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] log_rotate_interval = 1 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] log_rotate_interval_type = days {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] log_rotation_type = none {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] max_age = 0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] max_logfile_count = 30 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] max_logfile_size_mb = 200 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] max_over_subscription_ratio = 20.0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] message_reap_interval = 86400 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] message_ttl = 2592000 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] migration_create_volume_timeout_secs = 300 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] monkey_patch = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] monkey_patch_modules = [] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] my_ip = 192.168.122.130 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] no_snapshot_gb_quota = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] num_iser_scan_tries = 3 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] num_shell_tries = 3 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] num_volume_device_scan_tries = 3 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] nvmeof_conn_info_version = 1 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] nvmet_ns_id = 10 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] nvmet_port_id = 1 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] osapi_max_limit = 1000 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] osapi_volume_ext_list = [] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] osapi_volume_listen_port = 8776 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] osapi_volume_use_ssl = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] osapi_volume_workers = 2 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] per_volume_size_limit = -1 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] periodic_fuzzy_delay = 60 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] periodic_interval = 60 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] public_endpoint = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] publish_errors = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] quota_backup_gigabytes = 1000 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] quota_backups = 10 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] quota_gigabytes = 1000 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] quota_groups = 10 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] quota_snapshots = 10 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] quota_volumes = 10 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] rate_limit_burst = 0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] rate_limit_except_level = CRITICAL {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] rate_limit_interval = 0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] reinit_driver_count = 3 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] replication_device = **** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] report_discard_supported = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] report_interval = 120 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] reservation_clean_interval = 86400 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] reservation_expire = 86400 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] reserved_image_namespaces = [] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] reserved_percentage = 0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] rpc_response_timeout = 120 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] run_external_periodic_tasks = True {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] scst_target_driver = iscsi {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] scst_target_iqn_name = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] service_down_time = 720 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] shell_completion = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] snapshot_name_template = snapshot-%s {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] snapshot_same_host = True {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] split_loggers = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] state_path = /opt/stack/data/cinder {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] storage_availability_zone = nova {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] storage_protocol = iSCSI {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] syslog_log_facility = LOG_USER {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] target_helper = lioadm {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] target_ip_address = 192.168.122.130 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] target_port = 3260 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] target_protocol = iscsi {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] target_secondary_ip_addresses = [] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] trace_flags = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72421]: INFO cinder.volume.manager [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] transport_url = **** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] until_refresh = 0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] use_chap_auth = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] use_default_quota_class = True {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] use_journal = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] use_json = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] use_multipath_for_image_xfer = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] use_stderr = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] use_syslog = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] verify_glance_signatures = enabled {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] volume_api_class = cinder.volume.api.API {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] volume_backend_name = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] volume_clear = zero {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] volume_clear_ionice = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] volume_clear_size = 0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] volume_copy_bps_limit = 0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] volume_dd_blocksize = 1M {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] volume_name_template = volume-%s {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] volume_service_inithost_offload = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] volume_usage_audit_period = month {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] zoning_mode = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_concurrency.disable_process_locking = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.012s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.admin_password = **** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.admin_token = **** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.admin_user = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.auth_port = 35357 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.auth_protocol = https {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.auth_section = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.auth_type = password {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.auth_uri = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.auth_version = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.cache = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.certfile = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.identity_uri = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.include_service_catalog = True {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.insecure = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.interface = public {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.keyfile = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.memcache_password = {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.memcache_username = {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.region_name = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.service_type = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.130/identity {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.backend = dogpile.cache.null {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.backend_argument = **** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.backend_expiration_time = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.config_prefix = cache.oslo {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.debug_cache_backend = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.enable_retry_client = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.enable_socket_keepalive = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.enabled = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.enforce_fips_mode = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.expiration_time = 600 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.hashclient_retry_attempts = 2 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.memcache_dead_retry = 300 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.memcache_pool_maxsize = 10 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.memcache_sasl_enabled = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.password = **** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.proxies = [] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.redis_db = 0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.redis_server = localhost:6379 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.retry_attempts = 2 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.retry_delay = 0.0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.011s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:55 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.socket_keepalive_count = 1 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.socket_keepalive_idle = 1 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.socket_keepalive_interval = 1 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.socket_timeout = 1.0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.tls_allowed_ciphers = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.tls_cafile = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.tls_certfile = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.tls_enabled = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.tls_keyfile = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cache.username = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] coordination.backend_url = **** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] database.asyncio_connection = **** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] database.asyncio_slave_connection = **** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] database.backend = sqlalchemy {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] database.connection = **** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] database.connection_debug = 0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] database.connection_parameters = {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] database.connection_recycle_time = 3600 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] database.connection_trace = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] database.db_inc_retry_interval = True {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] database.db_max_retries = 20 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] database.db_max_retry_interval = 10 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] database.db_retry_interval = 1 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] database.max_overflow = 50 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] database.max_pool_size = 5 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] database.max_retries = 10 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] database.mysql_wsrep_sync_wait = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] database.pool_timeout = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] database.retry_interval = 10 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] database.slave_connection = **** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] database.sqlite_synchronous = True {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] database.synchronous_reader = True {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] database.use_db_reconnect = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] profiler.connection_string = messaging:// {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] profiler.enabled = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] profiler.es_doc_type = notification {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] profiler.es_scroll_size = 10000 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] profiler.es_scroll_time = 2m {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] profiler.filter_error_trace = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] profiler.hmac_keys = **** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] profiler.sentinel_service_name = mymaster {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] profiler.socket_timeout = 0.1 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] profiler.trace_requests = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] profiler.trace_sqlalchemy = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] profiler_jaeger.process_tags = {} {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] profiler_jaeger.service_name_prefix = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] profiler_otlp.service_name_prefix = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_policy.enforce_new_defaults = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: WARNING oslo_config.cfg [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_policy.enforce_scope = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_policy.policy_default_rule = default {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_policy.policy_file = policy.yaml {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] privsep_osbrick.group = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] privsep_osbrick.helper_command = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] privsep_osbrick.user = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cinder_sys_admin.group = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cinder_sys_admin.helper_command = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] cinder_sys_admin.user = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] service_user.auth_section = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] service_user.auth_type = password {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] service_user.cafile = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] service_user.certfile = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] service_user.collect_timing = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] service_user.insecure = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] service_user.keyfile = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] service_user.send_service_user_token = True {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] service_user.split_loggers = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] service_user.timeout = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] glance.auth_section = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] glance.auth_type = password {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] glance.certfile = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] glance.collect_timing = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] glance.insecure = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] glance.keyfile = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] glance.region_name = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] glance.split_loggers = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] glance.timeout = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.backend_availability_zone = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.chap_password = **** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.chap_username = {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.disk_geometry = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.driver_client_cert = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.driver_client_cert_key = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack sudo[72425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 21 20:46:55 devstack sudo[72425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.driver_data_namespace = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.driver_use_ssl = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.extra_capabilities = {} {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.filter_function = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.goodness_function = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.iscsi_target_flags = {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.iscsi_write_cache = on {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.iser_helper = tgtadm {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.iser_ip_address = 192.168.122.130 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.iser_port = 3260 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.lvm_share_target = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.lvm_type = auto {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.num_shell_tries = 3 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.replication_device = **** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.report_discard_supported = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.reserved_percentage = 0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.target_helper = tgtadm {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.target_ip_address = 192.168.122.130 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.target_port = 3260 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.target_protocol = iscsi {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.trace_flags = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.unique_fqdn_network = True {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.use_chap_auth = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.volume_backend_name = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.volume_clear = zero {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.volume_clear_ionice = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.volume_clear_size = 0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_reports.file_event_handler = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_reports.log_dir = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.backend_host = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.chap_password = **** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.chap_username = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.disk_geometry = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.driver_client_cert = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.extra_capabilities = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.filter_function = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.goodness_function = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.iser_helper = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.iser_ip_address = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.iser_port = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.lvm_share_target = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.lvm_type = auto {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.num_shell_tries = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.replication_device = **** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.report_discard_supported = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.reserved_percentage = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.scst_target_driver = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.storage_protocol = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.target_helper = lioadm {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.target_ip_address = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.target_port = 3260 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.trace_flags = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.use_chap_auth = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.volume_clear = zero {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.volume_clear_size = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] lvmdriver-1.volumes_dir = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.ssl = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_notifications.driver = [] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_notifications.retry = -1 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] key_manager.fixed_key = **** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican.barbican_api_version = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican.barbican_endpoint = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican.barbican_endpoint_type = public {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican.barbican_region_name = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican.cafile = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican.certfile = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican.collect_timing = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican.insecure = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican.keyfile = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican.number_of_retries = 60 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican.retry_delay = 1 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican.send_service_user_token = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican.split_loggers = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican.timeout = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican.verify_ssl = True {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican.verify_ssl_path = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican_service_user.auth_section = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican_service_user.auth_type = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican_service_user.cafile = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican_service_user.certfile = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican_service_user.collect_timing = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican_service_user.insecure = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican_service_user.keyfile = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican_service_user.split_loggers = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] barbican_service_user.timeout = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] vault.approle_role_id = **** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] vault.approle_secret_id = **** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] vault.kv_mountpoint = secret {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] vault.kv_path = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] vault.kv_version = 2 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] vault.namespace = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] vault.root_token_id = **** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] vault.ssl_ca_crt_file = None {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] vault.timeout = 60.0 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] vault.use_ssl = False {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:55 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] ******************************************************************************** {{(pid=72298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 21 20:46:55 devstack sudo[72425]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:55 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.600s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:55 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:55 devstack sudo[72540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:46:55 devstack sudo[72540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:56 devstack sudo[72540]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:56 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.499s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:56 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:46:56 devstack cinder-volume[72421]: INFO cinder.brick.local_dev.lvm [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 21 20:46:56 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:56 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:56 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:56 devstack sudo[72760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:46:56 devstack sudo[72760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:56 devstack sudo[72760]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:56 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:56 devstack cinder-volume[72421]: DEBUG cinder.brick.local_dev.lvm [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72421) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 21 20:46:56 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:56 devstack sudo[72918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:46:57 devstack sudo[72918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:57 devstack sudo[72918]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:57 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.003s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:57 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:57 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:57 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:57 devstack sudo[73116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:46:57 devstack sudo[73116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:58 devstack sudo[73116]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:58 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.471s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:58 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:58 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:58 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:58 devstack sudo[73123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 21 20:46:58 devstack sudo[73123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:58 devstack sudo[73123]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:58 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.419s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:58 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:58 devstack sudo[73127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:46:58 devstack sudo[73127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:59 devstack sudo[73127]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:59 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:59 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:59 devstack sudo[73132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:46:59 devstack sudo[73132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:59 devstack sudo[73132]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:59 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.487s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:59 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:59 devstack sudo[73135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:46:59 devstack sudo[73135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:00 devstack sudo[73135]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:00 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:00 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:00 devstack sudo[73143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:47:00 devstack sudo[73143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:00 devstack sudo[73143]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:00 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.435s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:00 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:00 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:00 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:00 devstack sudo[73147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:47:00 devstack sudo[73147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:01 devstack sudo[73147]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:01 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.611s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:01 devstack cinder-volume[72421]: INFO cinder.volume.drivers.lvm [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 21 20:47:01 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:01 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.011s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:01 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:01 devstack sudo[73266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:47:01 devstack sudo[73266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:01 devstack sudo[73266]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:01 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.497s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:01 devstack cinder-volume[72421]: DEBUG cinder.volume.drivers.lvm [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Updating volume stats {{(pid=72421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 20:47:01 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:01 devstack sudo[73401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:47:01 devstack sudo[73401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:02 devstack sudo[73401]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:02 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:02 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:02 devstack sudo[73411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:47:02 devstack sudo[73411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:02 devstack sudo[73411]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:02 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.487s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:02 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:02 devstack sudo[73414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:47:02 devstack sudo[73414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:03 devstack sudo[73414]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:03 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.462s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:03 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:03 devstack sudo[73417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:47:03 devstack sudo[73417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:03 devstack sudo[73417]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:03 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.496s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:03 devstack cinder-volume[72421]: INFO cinder.volume.driver [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Driver hasn't implemented _init_vendor_properties() Apr 21 20:47:03 devstack cinder-volume[72421]: DEBUG cinder.volume.driver [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72421) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 21 20:47:03 devstack cinder-volume[72421]: DEBUG oslo_db.sqlalchemy.engines [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72421) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:47:03 devstack cinder-volume[72421]: DEBUG dbcounter [-] [72421] Writer thread running {{(pid=72421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:47:03 devstack cinder-volume[72421]: DEBUG cinder.db.sqlalchemy.api [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Building query based on filter {{(pid=72421) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 21 20:47:03 devstack cinder-volume[72421]: DEBUG cinder.image.image_utils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72421) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 21 20:47:03 devstack cinder-volume[72421]: INFO cinder.keymgr.migration [None req-24b292ba-2e2e-4515-977a-f6b4ddea1a87 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 21 20:47:03 devstack cinder-volume[72421]: DEBUG cinder.volume.drivers.lvm [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Updating volume stats {{(pid=72421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 20:47:03 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:03 devstack sudo[73422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:47:03 devstack sudo[73422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:04 devstack sudo[73422]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:04 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.521s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:04 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:04 devstack sudo[73431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:47:04 devstack sudo[73431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:04 devstack sudo[73431]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:04 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:04 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:04 devstack sudo[73436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:47:04 devstack sudo[73436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:05 devstack cinder-volume[72298]: DEBUG dbcounter [-] [72298] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72298) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:47:05 devstack sudo[73436]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:05 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.456s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:05 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:05 devstack sudo[73440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:47:05 devstack sudo[73440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:05 devstack sudo[73440]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:05 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:05 devstack cinder-volume[72421]: DEBUG cinder.manager [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Notifying Schedulers of capabilities ... {{(pid=72421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:47:05 devstack cinder-volume[72421]: INFO cinder.volume.manager [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Driver initialization completed successfully. Apr 21 20:47:05 devstack cinder-volume[72421]: INFO cinder.manager [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Initiating service 2 cleanup Apr 21 20:47:05 devstack cinder-volume[72421]: INFO cinder.manager [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Service 2 cleanup completed. Apr 21 20:47:05 devstack cinder-volume[72421]: DEBUG cinder.service [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Creating RPC server for service cinder-volume {{(pid=72421) start /opt/stack/cinder/cinder/service.py:231}} Apr 21 20:47:05 devstack cinder-volume[72421]: DEBUG cinder.service [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72421) start /opt/stack/cinder/cinder/service.py:237}} Apr 21 20:47:05 devstack cinder-volume[72421]: INFO cinder.volume.manager [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 21 20:47:05 devstack cinder-volume[72421]: DEBUG cinder.volume.drivers.lvm [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Updating volume stats {{(pid=72421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 20:47:05 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:05 devstack sudo[73498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:47:05 devstack sudo[73498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:06 devstack sudo[73498]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:06 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:06 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:06 devstack sudo[73504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:47:06 devstack sudo[73504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:06 devstack sudo[73504]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:06 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:06 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:06 devstack sudo[73507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:47:06 devstack sudo[73507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:07 devstack sudo[73507]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:07 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.409s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:07 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:07 devstack sudo[73510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:47:07 devstack sudo[73510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:07 devstack sudo[73510]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:07 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.420s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:07 devstack cinder-volume[72421]: INFO cinder.volume.manager [None req-b7079bac-3f3b-485d-ae42-061a95aa6160 None None] Driver post RPC initialization completed successfully. Apr 21 20:47:15 devstack cinder-volume[72421]: DEBUG dbcounter [-] [72421] Writing DB stats cinder:SELECT=2 {{(pid=72421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:47:17 devstack cinder-volume[72421]: DEBUG dbcounter [-] [72421] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:48:52 devstack cinder-volume[72421]: DEBUG oslo_service.periodic_task [None req-e240d1a2-f0e9-45ca-be6e-e3ef2f87401f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:48:52 devstack cinder-volume[72421]: DEBUG cinder.volume.drivers.lvm [None req-e240d1a2-f0e9-45ca-be6e-e3ef2f87401f None None] Updating volume stats {{(pid=72421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 20:48:52 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-e240d1a2-f0e9-45ca-be6e-e3ef2f87401f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:52 devstack sudo[78546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:48:52 devstack sudo[78546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:52 devstack sudo[78546]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:52 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-e240d1a2-f0e9-45ca-be6e-e3ef2f87401f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:52 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-e240d1a2-f0e9-45ca-be6e-e3ef2f87401f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:52 devstack sudo[78586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:48:52 devstack sudo[78586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:53 devstack sudo[78586]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:53 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-e240d1a2-f0e9-45ca-be6e-e3ef2f87401f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:53 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-e240d1a2-f0e9-45ca-be6e-e3ef2f87401f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:53 devstack sudo[78599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:48:53 devstack sudo[78599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:53 devstack sudo[78599]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:53 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-e240d1a2-f0e9-45ca-be6e-e3ef2f87401f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.408s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:53 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-e240d1a2-f0e9-45ca-be6e-e3ef2f87401f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:53 devstack sudo[78602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:48:53 devstack sudo[78602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:54 devstack sudo[78602]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:54 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-e240d1a2-f0e9-45ca-be6e-e3ef2f87401f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.424s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:54 devstack cinder-volume[72421]: DEBUG cinder.manager [None req-e240d1a2-f0e9-45ca-be6e-e3ef2f87401f None None] Notifying Schedulers of capabilities ... {{(pid=72421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:49:17 devstack cinder-volume[72421]: DEBUG dbcounter [-] [72421] Writing DB stats cinder:SELECT=1 {{(pid=72421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:49:17 devstack cinder-volume[72421]: DEBUG dbcounter [-] [72421] Writing DB stats cinder:UPDATE=1 {{(pid=72421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:49:52 devstack cinder-volume[72421]: DEBUG oslo_service.periodic_task [None req-e240d1a2-f0e9-45ca-be6e-e3ef2f87401f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:49:52 devstack cinder-volume[72421]: DEBUG cinder.volume.drivers.lvm [None req-e240d1a2-f0e9-45ca-be6e-e3ef2f87401f None None] Updating volume stats {{(pid=72421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 20:49:52 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-e240d1a2-f0e9-45ca-be6e-e3ef2f87401f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:52 devstack sudo[80694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:49:52 devstack sudo[80694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:52 devstack sudo[80694]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:52 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-e240d1a2-f0e9-45ca-be6e-e3ef2f87401f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:52 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-e240d1a2-f0e9-45ca-be6e-e3ef2f87401f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:52 devstack sudo[80698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:49:52 devstack sudo[80698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:53 devstack sudo[80698]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:53 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-e240d1a2-f0e9-45ca-be6e-e3ef2f87401f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:53 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-e240d1a2-f0e9-45ca-be6e-e3ef2f87401f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:53 devstack sudo[80746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:49:53 devstack sudo[80746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:53 devstack sudo[80746]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:53 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-e240d1a2-f0e9-45ca-be6e-e3ef2f87401f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.473s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:53 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-e240d1a2-f0e9-45ca-be6e-e3ef2f87401f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:53 devstack sudo[80749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:49:53 devstack sudo[80749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:54 devstack sudo[80749]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:54 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-e240d1a2-f0e9-45ca-be6e-e3ef2f87401f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:54 devstack cinder-volume[72421]: DEBUG cinder.manager [None req-e240d1a2-f0e9-45ca-be6e-e3ef2f87401f None None] Notifying Schedulers of capabilities ... {{(pid=72421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:50:22 devstack cinder-volume[72298]: INFO oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Caught SIGTERM, stopping children Apr 21 20:50:22 devstack cinder-volume[72298]: DEBUG oslo_concurrency.lockutils [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Acquiring lock "singleton_lock" {{(pid=72298) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:50:22 devstack cinder-volume[72298]: DEBUG oslo_concurrency.lockutils [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Acquired lock "singleton_lock" {{(pid=72298) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:50:22 devstack cinder-volume[72298]: DEBUG oslo_concurrency.lockutils [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Releasing lock "singleton_lock" {{(pid=72298) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:50:22 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Stop services. {{(pid=72298) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 21 20:50:22 devstack cinder-volume[72298]: DEBUG oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Killing children. {{(pid=72298) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 21 20:50:22 devstack cinder-volume[72298]: INFO oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Waiting on 1 children to exit Apr 21 20:50:25 devstack cinder-volume[72421]: DEBUG oslo_concurrency.lockutils [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Acquiring lock "singleton_lock" {{(pid=72421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:50:25 devstack cinder-volume[72421]: DEBUG oslo_concurrency.lockutils [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Acquired lock "singleton_lock" {{(pid=72421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:50:25 devstack cinder-volume[72421]: DEBUG oslo_concurrency.lockutils [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Releasing lock "singleton_lock" {{(pid=72421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:50:25 devstack cinder-volume[72421]: WARNING amqp [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 21 20:50:25 devstack cinder-volume[72421]: WARNING amqp [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 21 20:50:25 devstack cinder-volume[72298]: INFO oslo_service.backend._eventlet.service [None req-fb5e7d34-4469-4ace-8917-847c946f0461 None None] Child 72421 exited with status 0 Apr 21 20:50:26 devstack cinder-volume[81471]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 21 20:50:26 devstack cinder-volume[81471]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 20:50:26 devstack cinder-volume[81471]: we strongly recommend against using it for new projects. Apr 21 20:50:26 devstack cinder-volume[81471]: If you are already using Eventlet, we recommend migrating to a different Apr 21 20:50:26 devstack cinder-volume[81471]: framework. For more detail see Apr 21 20:50:26 devstack cinder-volume[81471]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 20:50:26 devstack cinder-volume[81471]: import eventlet # noqa Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:50:28 devstack cinder-volume[81471]: INFO dbcounter [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Registered counter for database cinder Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_db.sqlalchemy.engines [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81471) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG dbcounter [-] [81471] Writer thread running {{(pid=81471) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:50:28 devstack cinder-volume[81471]: INFO cinder.rpc [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 21 20:50:28 devstack cinder-volume[81471]: INFO cinder.rpc [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_db.sqlalchemy.engines [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81471) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:50:28 devstack cinder-volume[81471]: INFO cinder.volume.manager [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Determined volume DB was empty at startup. Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG cinder.volume.manager [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81471) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 21 20:50:28 devstack cinder-volume[81471]: INFO cinder.volume.manager [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 21 20:50:28 devstack cinder-volume[81471]: WARNING stevedore.named [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 21 20:50:28 devstack cinder-volume[81471]: WARNING castellan.key_manager [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:50:28 devstack cinder-volume[81471]: WARNING cinder.keymgr.conf_key_mgr [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:50:28 devstack cinder-volume[81471]: INFO cinder.volume.manager [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_db.sqlalchemy.engines [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81471) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:50:28 devstack cinder-volume[81471]: INFO oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Starting 1 workers Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Started child 81589 {{(pid=81471) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Full set of CONF: {{(pid=81471) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] ******************************************************************************** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Configuration options gathered from: {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] ================================================================================ {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] allow_availability_zone_fallback = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] allow_compression_on_image_upload = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81589]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] allowed_direct_url_schemes = [] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] api_rate_limit = True {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] auth_strategy = keystone {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_availability_zone = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_host = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_name = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_stats_polling_interval = 60 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backup_api_class = cinder.backup.api.API {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backup_name_template = backup-%s {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backup_use_same_host = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backup_use_temp_snapshot = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] chap_password = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] chap_username = {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cinder_internal_tenant_project_id = 70e5832dfbd54fbbab85fcdfe4c605b7 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cinder_internal_tenant_user_id = 2c6cabd9352a41468aa1654eb228d9aa {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cluster = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] compression_format = gzip {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] compute_api_class = cinder.compute.nova.API {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] config_dir = [] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] config_source = [] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] control_exchange = openstack {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] debug = True {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] default_availability_zone = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] default_group_type = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] default_volume_type = QuobyteHD {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] disk_geometry = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] driver_client_cert = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] driver_client_cert_key = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] driver_data_namespace = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] driver_ssl_cert_path = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] driver_ssl_cert_verify = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] driver_use_ssl = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] enable_new_services = True {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] enable_unsupported_driver = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] enabled_backends = ['QuobyteHD'] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] enforce_multipath_for_image_xfer = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] filter_function = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] glance_api_insecure = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] glance_api_servers = ['http://192.168.122.130/image'] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] glance_api_ssl_compression = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] glance_ca_certificates_file = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] glance_catalog_info = image:glance:publicURL {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] glance_certfile = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] glance_keyfile = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] glance_num_retries = 3 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] glance_request_timeout = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] goodness_function = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] graceful_shutdown_timeout = 5 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] group_api_class = cinder.group.api.API {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] host = devstack {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] image_compress_on_upload = True {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] image_conversion_address_space_limit = 1 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] image_conversion_cpu_limit = 60 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] image_conversion_disable = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] image_upload_use_cinder_backend = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] image_upload_use_internal_tenant = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] image_volume_cache_enabled = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] image_volume_cache_max_count = 0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] image_volume_cache_max_size_gb = 0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] init_host_max_objects_retrieval = 0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] instance_format = [instance: %(uuid)s] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] iscsi_target_flags = {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] iscsi_write_cache = on {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] iser_helper = tgtadm {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] iser_ip_address = 192.168.122.130 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] iser_port = 3260 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] log_color = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] log_config_append = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] log_dir = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] log_file = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] log_options = True {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] log_rotate_interval = 1 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] log_rotate_interval_type = days {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] log_rotation_type = none {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] max_age = 0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] max_logfile_count = 30 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] max_logfile_size_mb = 200 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] max_over_subscription_ratio = 20.0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] message_reap_interval = 86400 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] message_ttl = 2592000 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] migration_create_volume_timeout_secs = 300 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] monkey_patch = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] monkey_patch_modules = [] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] my_ip = 192.168.122.130 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] no_snapshot_gb_quota = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] num_iser_scan_tries = 3 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] num_shell_tries = 3 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] num_volume_device_scan_tries = 3 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] nvmeof_conn_info_version = 1 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81589]: INFO cinder.volume.manager [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] nvmet_ns_id = 10 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] nvmet_port_id = 1 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] osapi_max_limit = 1000 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81589]: DEBUG cinder.volume.drivers.remotefs [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81589) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] osapi_volume_ext_list = [] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] osapi_volume_listen_port = 8776 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] osapi_volume_use_ssl = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] osapi_volume_workers = 2 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] per_volume_size_limit = -1 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] periodic_fuzzy_delay = 60 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] periodic_interval = 60 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] public_endpoint = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] publish_errors = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] quota_backup_gigabytes = 1000 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] quota_backups = 10 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] quota_gigabytes = 1000 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] quota_groups = 10 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] quota_snapshots = 10 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] quota_volumes = 10 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] rate_limit_burst = 0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] rate_limit_except_level = CRITICAL {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] rate_limit_interval = 0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] reinit_driver_count = 3 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] replication_device = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] report_discard_supported = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] report_interval = 120 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] reservation_clean_interval = 86400 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] reservation_expire = 86400 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] reserved_image_namespaces = [] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] reserved_percentage = 0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] rpc_response_timeout = 120 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] run_external_periodic_tasks = True {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] scst_target_driver = iscsi {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] scst_target_iqn_name = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] service_down_time = 720 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] shell_completion = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] snapshot_name_template = snapshot-%s {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] split_loggers = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] state_path = /opt/stack/data/cinder {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] storage_availability_zone = nova {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] storage_protocol = iSCSI {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] syslog_log_facility = LOG_USER {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] target_helper = lioadm {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] target_ip_address = 192.168.122.130 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] target_port = 3260 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] target_protocol = iscsi {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] target_secondary_ip_addresses = [] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] trace_flags = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] transport_url = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] until_refresh = 0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] use_chap_auth = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] use_default_quota_class = True {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] use_journal = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] use_json = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] use_multipath_for_image_xfer = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] use_stderr = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] use_syslog = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] verify_glance_signatures = enabled {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] volume_api_class = cinder.volume.api.API {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] volume_backend_name = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] volume_clear = zero {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] volume_clear_ionice = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] volume_clear_size = 0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] volume_copy_bps_limit = 0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] volume_dd_blocksize = 1M {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] volume_name_template = volume-%s {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] volume_service_inithost_offload = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] volume_usage_audit_period = month {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] zoning_mode = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_concurrency.disable_process_locking = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.admin_password = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.admin_token = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.admin_user = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.auth_port = 35357 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.auth_protocol = https {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.auth_section = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.auth_type = password {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.auth_uri = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.auth_version = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.cache = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.certfile = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.identity_uri = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.include_service_catalog = True {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.insecure = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.interface = public {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.keyfile = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.memcache_password = {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:28 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.memcache_username = {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.region_name = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.service_type = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.130/identity {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.backend = dogpile.cache.null {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.backend_argument = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.backend_expiration_time = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.config_prefix = cache.oslo {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.debug_cache_backend = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.enable_retry_client = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.enable_socket_keepalive = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.enabled = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.enforce_fips_mode = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.expiration_time = 600 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.hashclient_retry_attempts = 2 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.memcache_dead_retry = 300 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.memcache_pool_maxsize = 10 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.memcache_sasl_enabled = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.password = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.proxies = [] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.redis_db = 0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.redis_server = localhost:6379 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.retry_attempts = 2 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.retry_delay = 0.0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.socket_keepalive_count = 1 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.socket_keepalive_idle = 1 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.socket_keepalive_interval = 1 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.socket_timeout = 1.0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.tls_allowed_ciphers = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.tls_cafile = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.tls_certfile = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.tls_enabled = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.tls_keyfile = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cache.username = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] coordination.backend_url = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] database.asyncio_connection = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] database.asyncio_slave_connection = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] database.backend = sqlalchemy {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] database.connection = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] database.connection_debug = 0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] database.connection_parameters = {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] database.connection_recycle_time = 3600 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] database.connection_trace = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] database.db_inc_retry_interval = True {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] database.db_max_retries = 20 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] database.db_max_retry_interval = 10 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] database.db_retry_interval = 1 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] database.max_overflow = 50 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] database.max_pool_size = 5 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] database.max_retries = 10 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] database.mysql_wsrep_sync_wait = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] database.pool_timeout = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] database.retry_interval = 10 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] database.slave_connection = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] database.sqlite_synchronous = True {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] database.synchronous_reader = True {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] database.use_db_reconnect = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] profiler.connection_string = messaging:// {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] profiler.enabled = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] profiler.es_doc_type = notification {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] profiler.es_scroll_size = 10000 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] profiler.es_scroll_time = 2m {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] profiler.filter_error_trace = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] profiler.hmac_keys = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] profiler.sentinel_service_name = mymaster {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] profiler.socket_timeout = 0.1 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] profiler.trace_requests = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] profiler.trace_sqlalchemy = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] profiler_jaeger.process_tags = {} {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] profiler_jaeger.service_name_prefix = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] profiler_otlp.service_name_prefix = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_policy.enforce_new_defaults = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: WARNING oslo_config.cfg [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_policy.enforce_scope = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_policy.policy_default_rule = default {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_policy.policy_file = policy.yaml {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] privsep_osbrick.group = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] privsep_osbrick.helper_command = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81589]: DEBUG cinder.volume.drivers.quobyte [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81589) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81589]: WARNING cinder.volume.drivers.quobyte [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81589]: WARNING cinder.volume.drivers.quobyte [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] privsep_osbrick.user = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cinder_sys_admin.group = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cinder_sys_admin.helper_command = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81589]: DEBUG oslo_concurrency.processutils [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Running cmd (subprocess): mount.quobyte {{(pid=81589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] cinder_sys_admin.user = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] service_user.auth_section = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] service_user.auth_type = password {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] service_user.cafile = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] service_user.certfile = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] service_user.collect_timing = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] service_user.insecure = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] service_user.keyfile = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] service_user.send_service_user_token = True {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] service_user.split_loggers = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] service_user.timeout = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] glance.auth_section = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] glance.auth_type = password {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] glance.certfile = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] glance.collect_timing = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] glance.insecure = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] glance.keyfile = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] glance.region_name = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] glance.split_loggers = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] glance.timeout = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.backend_availability_zone = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.chap_password = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.chap_username = {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.disk_geometry = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.driver_client_cert = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.driver_client_cert_key = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.driver_data_namespace = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.driver_use_ssl = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.extra_capabilities = {} {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.filter_function = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.goodness_function = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.iscsi_target_flags = {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.iscsi_write_cache = on {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.iser_helper = tgtadm {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.iser_ip_address = 192.168.122.130 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.iser_port = 3260 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.nas_host = {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.nas_login = admin {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.nas_mount_options = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.nas_password = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.nas_private_key = {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.nas_share_path = {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.num_shell_tries = 3 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.quobyte_volume_url = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.replication_device = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.report_discard_supported = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.reserved_percentage = 0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.target_helper = tgtadm {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.target_ip_address = 192.168.122.130 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.target_port = 3260 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.target_protocol = iscsi {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.trace_flags = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.unique_fqdn_network = True {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.use_chap_auth = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.volume_backend_name = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.volume_clear = zero {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.volume_clear_ionice = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.volume_clear_size = 0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_reports.file_event_handler = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_reports.log_dir = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.backend_availability_zone = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.backend_host = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.chap_password = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.chap_username = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.chiscsi_conf = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.disk_geometry = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.driver_client_cert = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.driver_data_namespace = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.driver_use_ssl = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.extra_capabilities = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.filter_function = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.goodness_function = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.iser_helper = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.iser_ip_address = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.iser_port = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.iser_target_prefix = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.nas_host = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.nas_login = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.nas_mount_options = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.nas_password = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.nas_private_key = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.nas_share_path = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.nas_ssh_port = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.num_shell_tries = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.nvmet_port_id = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.replication_device = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.report_discard_supported = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.reserved_percentage = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.scst_target_driver = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.storage_protocol = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.target_helper = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.target_ip_address = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.target_port = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.target_prefix = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.target_protocol = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.trace_flags = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.use_chap_auth = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.volume_clear = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.volume_clear_size = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] QuobyteHD.volumes_dir = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.ssl = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_notifications.driver = [] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_notifications.retry = -1 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] key_manager.fixed_key = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican.barbican_api_version = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican.barbican_endpoint = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican.barbican_endpoint_type = public {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican.barbican_region_name = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican.cafile = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican.certfile = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican.collect_timing = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican.insecure = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican.keyfile = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican.number_of_retries = 60 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican.retry_delay = 1 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican.send_service_user_token = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican.split_loggers = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican.timeout = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican.verify_ssl = True {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican.verify_ssl_path = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican_service_user.auth_section = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican_service_user.auth_type = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican_service_user.cafile = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican_service_user.certfile = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican_service_user.collect_timing = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican_service_user.insecure = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican_service_user.keyfile = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican_service_user.split_loggers = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] barbican_service_user.timeout = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] vault.approle_role_id = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] vault.approle_secret_id = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] vault.kv_mountpoint = secret {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] vault.kv_path = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] vault.kv_version = 2 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] vault.namespace = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] vault.root_token_id = **** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] vault.ssl_ca_crt_file = None {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] vault.timeout = 60.0 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] vault.use_ssl = False {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:29 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] ******************************************************************************** {{(pid=81471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 21 20:50:29 devstack quobyte-client[81590]: Reading configuration file: /etc/quobyte/client.cfg Apr 21 20:50:29 devstack quobyte-client[81590]: Invalid parameters found, error: missing mount point. Apr 21 20:50:29 devstack quobyte-client[81590]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 21 20:50:29 devstack quobyte-client[81590]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 21 20:50:29 devstack cinder-volume[81589]: DEBUG oslo_concurrency.processutils [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] CMD "mount.quobyte" returned: 1 in 0.085s {{(pid=81589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:29 devstack cinder-volume[81589]: DEBUG oslo_concurrency.lockutils [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81589) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:50:29 devstack cinder-volume[81589]: DEBUG oslo_concurrency.lockutils [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81589) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:50:29 devstack cinder-volume[81589]: DEBUG cinder.volume.drivers.quobyte [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81589) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:50:29 devstack cinder-volume[81589]: INFO cinder.volume.drivers.quobyte [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 ... Apr 21 20:50:29 devstack cinder-volume[81589]: DEBUG oslo_concurrency.processutils [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 -c /etc/quobyte/client-cinder.cfg {{(pid=81589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:29 devstack sudo[81591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 -c /etc/quobyte/client-cinder.cfg Apr 21 20:50:29 devstack sudo[81591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:50:29 devstack sudo[81591]: pam_unix(sudo:session): session closed for user root Apr 21 20:50:29 devstack cinder-volume[81589]: DEBUG oslo_concurrency.processutils [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.487s {{(pid=81589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:29 devstack cinder-volume[81589]: INFO cinder.volume.drivers.quobyte [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 succeeded Apr 21 20:50:29 devstack cinder-volume[81589]: DEBUG cinder.volume.drivers.quobyte [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81589) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:50:29 devstack cinder-volume[81589]: DEBUG oslo_concurrency.lockutils [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.493s {{(pid=81589) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:50:29 devstack cinder-volume[81589]: DEBUG oslo_concurrency.processutils [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:29 devstack sudo[81660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:50:29 devstack sudo[81660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:50:29 devstack sudo[81660]: pam_unix(sudo:session): session closed for user root Apr 21 20:50:29 devstack cinder-volume[81589]: DEBUG oslo_concurrency.processutils [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.377s {{(pid=81589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:29 devstack cinder-volume[81589]: INFO cinder.volume.driver [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Driver hasn't implemented _init_vendor_properties() Apr 21 20:50:29 devstack cinder-volume[81589]: DEBUG cinder.volume.driver [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327842712402, 'free_capacity_gb': 1775.7327842712402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81589) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 21 20:50:29 devstack cinder-volume[81589]: DEBUG oslo_db.sqlalchemy.engines [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81589) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:50:30 devstack cinder-volume[81589]: DEBUG dbcounter [-] [81589] Writer thread running {{(pid=81589) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:50:30 devstack cinder-volume[81589]: DEBUG cinder.db.sqlalchemy.api [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Building query based on filter {{(pid=81589) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 21 20:50:30 devstack cinder-volume[81589]: DEBUG cinder.image.image_utils [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81589) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 21 20:50:30 devstack cinder-volume[81589]: INFO cinder.keymgr.migration [None req-ee359326-d94d-4d7b-b844-714a91dad0a5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 21 20:50:30 devstack cinder-volume[81589]: DEBUG oslo_concurrency.lockutils [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81589) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:50:30 devstack cinder-volume[81589]: DEBUG oslo_concurrency.lockutils [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81589) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:50:30 devstack cinder-volume[81589]: DEBUG cinder.volume.drivers.quobyte [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81589) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:50:30 devstack cinder-volume[81589]: DEBUG cinder.volume.drivers.quobyte [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81589) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:50:30 devstack cinder-volume[81589]: DEBUG oslo_concurrency.lockutils [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81589) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:50:30 devstack cinder-volume[81589]: DEBUG oslo_concurrency.processutils [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:30 devstack sudo[81663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:50:30 devstack sudo[81663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:50:30 devstack sudo[81663]: pam_unix(sudo:session): session closed for user root Apr 21 20:50:30 devstack cinder-volume[81589]: DEBUG oslo_concurrency.processutils [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.372s {{(pid=81589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:30 devstack cinder-volume[81589]: DEBUG cinder.manager [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Notifying Schedulers of capabilities ... {{(pid=81589) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:50:30 devstack cinder-volume[81589]: INFO cinder.volume.manager [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Driver initialization completed successfully. Apr 21 20:50:30 devstack cinder-volume[81589]: INFO cinder.manager [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Initiating service 3 cleanup Apr 21 20:50:30 devstack cinder-volume[81589]: INFO cinder.manager [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Service 3 cleanup completed. Apr 21 20:50:30 devstack cinder-volume[81589]: DEBUG cinder.service [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Creating RPC server for service cinder-volume {{(pid=81589) start /opt/stack/cinder/cinder/service.py:231}} Apr 21 20:50:30 devstack cinder-volume[81589]: DEBUG cinder.service [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81589) start /opt/stack/cinder/cinder/service.py:237}} Apr 21 20:50:30 devstack cinder-volume[81589]: INFO cinder.volume.manager [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 21 20:50:30 devstack cinder-volume[81589]: DEBUG oslo_concurrency.lockutils [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81589) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:50:30 devstack cinder-volume[81589]: DEBUG oslo_concurrency.lockutils [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81589) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:50:30 devstack cinder-volume[81589]: DEBUG cinder.volume.drivers.quobyte [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81589) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:50:30 devstack cinder-volume[81589]: DEBUG cinder.volume.drivers.quobyte [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81589) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:50:30 devstack cinder-volume[81589]: DEBUG oslo_concurrency.lockutils [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81589) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:50:30 devstack cinder-volume[81589]: DEBUG oslo_concurrency.processutils [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:30 devstack sudo[81667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:50:30 devstack sudo[81667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:50:30 devstack sudo[81667]: pam_unix(sudo:session): session closed for user root Apr 21 20:50:30 devstack cinder-volume[81589]: DEBUG oslo_concurrency.processutils [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.424s {{(pid=81589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:30 devstack cinder-volume[81589]: INFO cinder.volume.manager [None req-fda2838a-3fc3-4063-bed9-3f04e0ef8622 None None] Driver post RPC initialization completed successfully. Apr 21 20:50:33 devstack cinder-volume[81589]: DEBUG oslo_concurrency.lockutils [None req-66525211-a0ca-41ae-bf26-75d5a881cb37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81589) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:50:33 devstack cinder-volume[81589]: DEBUG oslo_concurrency.lockutils [None req-66525211-a0ca-41ae-bf26-75d5a881cb37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81589) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:50:33 devstack cinder-volume[81589]: DEBUG cinder.volume.drivers.quobyte [None req-66525211-a0ca-41ae-bf26-75d5a881cb37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81589) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:50:33 devstack cinder-volume[81589]: DEBUG cinder.volume.drivers.quobyte [None req-66525211-a0ca-41ae-bf26-75d5a881cb37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81589) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:50:33 devstack cinder-volume[81589]: DEBUG oslo_concurrency.lockutils [None req-66525211-a0ca-41ae-bf26-75d5a881cb37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81589) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:50:33 devstack cinder-volume[81589]: DEBUG oslo_concurrency.processutils [None req-66525211-a0ca-41ae-bf26-75d5a881cb37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:33 devstack sudo[81733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:50:33 devstack sudo[81733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:50:34 devstack sudo[81733]: pam_unix(sudo:session): session closed for user root Apr 21 20:50:34 devstack cinder-volume[81589]: DEBUG oslo_concurrency.processutils [None req-66525211-a0ca-41ae-bf26-75d5a881cb37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.402s {{(pid=81589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:34 devstack cinder-volume[81589]: DEBUG cinder.manager [None req-66525211-a0ca-41ae-bf26-75d5a881cb37 None None] Notifying Schedulers of capabilities ... {{(pid=81589) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:50:37 devstack cinder-volume[81471]: INFO oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Caught SIGTERM, stopping children Apr 21 20:50:37 devstack cinder-volume[81471]: DEBUG oslo_concurrency.lockutils [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Acquiring lock "singleton_lock" {{(pid=81471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:50:37 devstack cinder-volume[81471]: DEBUG oslo_concurrency.lockutils [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Acquired lock "singleton_lock" {{(pid=81471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:50:37 devstack cinder-volume[81471]: DEBUG oslo_concurrency.lockutils [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Releasing lock "singleton_lock" {{(pid=81471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:50:37 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Stop services. {{(pid=81471) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 21 20:50:37 devstack cinder-volume[81471]: DEBUG oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Killing children. {{(pid=81471) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 21 20:50:37 devstack cinder-volume[81471]: INFO oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Waiting on 1 children to exit Apr 21 20:50:38 devstack cinder-volume[81589]: DEBUG oslo_concurrency.lockutils [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Acquiring lock "singleton_lock" {{(pid=81589) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:50:38 devstack cinder-volume[81589]: DEBUG oslo_concurrency.lockutils [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Acquired lock "singleton_lock" {{(pid=81589) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:50:38 devstack cinder-volume[81589]: DEBUG oslo_concurrency.lockutils [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Releasing lock "singleton_lock" {{(pid=81589) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:50:38 devstack cinder-volume[81589]: WARNING amqp [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 21 20:50:38 devstack cinder-volume[81589]: WARNING amqp [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 21 20:50:38 devstack cinder-volume[81471]: INFO oslo_service.backend._eventlet.service [None req-26475c60-7429-46a9-b787-83f3b9ea9ea4 None None] Child 81589 exited with status 0 Apr 21 20:50:39 devstack cinder-volume[81813]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 21 20:50:39 devstack cinder-volume[81813]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 20:50:39 devstack cinder-volume[81813]: we strongly recommend against using it for new projects. Apr 21 20:50:39 devstack cinder-volume[81813]: If you are already using Eventlet, we recommend migrating to a different Apr 21 20:50:39 devstack cinder-volume[81813]: framework. For more detail see Apr 21 20:50:39 devstack cinder-volume[81813]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 20:50:39 devstack cinder-volume[81813]: import eventlet # noqa Apr 21 20:50:40 devstack cinder-volume[81813]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:50:40 devstack cinder-volume[81813]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:50:40 devstack cinder-volume[81813]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:50:41 devstack cinder-volume[81813]: INFO dbcounter [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] Registered counter for database cinder Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_db.sqlalchemy.engines [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81813) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG dbcounter [-] [81813] Writer thread running {{(pid=81813) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:50:41 devstack cinder-volume[81813]: INFO cinder.rpc [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 21 20:50:41 devstack cinder-volume[81813]: INFO cinder.rpc [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_db.sqlalchemy.engines [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81813) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:50:41 devstack cinder-volume[81813]: INFO cinder.volume.manager [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] Determined volume DB was empty at startup. Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG cinder.volume.manager [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81813) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 21 20:50:41 devstack cinder-volume[81813]: WARNING stevedore.named [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 21 20:50:41 devstack cinder-volume[81813]: WARNING castellan.key_manager [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:50:41 devstack cinder-volume[81813]: WARNING cinder.keymgr.conf_key_mgr [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:50:41 devstack cinder-volume[81813]: INFO cinder.volume.manager [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_db.sqlalchemy.engines [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81813) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:50:41 devstack cinder-volume[81813]: INFO oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] Starting 1 workers Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] Started child 81957 {{(pid=81813) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] Full set of CONF: {{(pid=81813) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] ******************************************************************************** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] Configuration options gathered from: {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] ================================================================================ {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] allow_availability_zone_fallback = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] allow_compression_on_image_upload = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] allowed_direct_url_schemes = [] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] api_rate_limit = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] auth_strategy = keystone {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_availability_zone = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_host = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_name = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_stats_polling_interval = 60 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backup_api_class = cinder.backup.api.API {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backup_name_template = backup-%s {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backup_use_same_host = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backup_use_temp_snapshot = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] chap_password = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] chap_username = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cinder_internal_tenant_project_id = 70e5832dfbd54fbbab85fcdfe4c605b7 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cinder_internal_tenant_user_id = 2c6cabd9352a41468aa1654eb228d9aa {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cluster = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] compression_format = gzip {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] compute_api_class = cinder.compute.nova.API {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] config_dir = [] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] config_source = [] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] control_exchange = openstack {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] debug = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] default_availability_zone = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] default_group_type = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] default_volume_type = QuobyteHD {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81957]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] disk_geometry = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] driver_client_cert = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] driver_client_cert_key = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] driver_data_namespace = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] driver_ssl_cert_path = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] driver_ssl_cert_verify = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] driver_use_ssl = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] enable_new_services = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] enable_unsupported_driver = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] enabled_backends = ['QuobyteHD'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] enforce_multipath_for_image_xfer = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] filter_function = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] glance_api_insecure = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] glance_api_servers = ['http://192.168.122.130/image'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] glance_api_ssl_compression = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] glance_ca_certificates_file = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] glance_catalog_info = image:glance:publicURL {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] glance_certfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] glance_keyfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] glance_num_retries = 3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] glance_request_timeout = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] goodness_function = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] graceful_shutdown_timeout = 5 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] group_api_class = cinder.group.api.API {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] host = devstack {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] image_compress_on_upload = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] image_conversion_address_space_limit = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] image_conversion_cpu_limit = 60 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] image_conversion_disable = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] image_upload_use_cinder_backend = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] image_upload_use_internal_tenant = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] image_volume_cache_enabled = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] image_volume_cache_max_count = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] image_volume_cache_max_size_gb = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] init_host_max_objects_retrieval = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] instance_format = [instance: %(uuid)s] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] iscsi_target_flags = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] iscsi_write_cache = on {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] iser_helper = tgtadm {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] iser_ip_address = 192.168.122.130 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] iser_port = 3260 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] log_color = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] log_config_append = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] log_dir = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] log_file = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] log_options = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] log_rotate_interval = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] log_rotate_interval_type = days {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] log_rotation_type = none {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] max_age = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] max_logfile_count = 30 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] max_logfile_size_mb = 200 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] max_over_subscription_ratio = 20.0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] message_reap_interval = 86400 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] message_ttl = 2592000 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] migration_create_volume_timeout_secs = 300 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] monkey_patch = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] monkey_patch_modules = [] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] my_ip = 192.168.122.130 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] no_snapshot_gb_quota = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] num_iser_scan_tries = 3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] num_shell_tries = 3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] num_volume_device_scan_tries = 3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] nvmeof_conn_info_version = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] nvmet_ns_id = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] nvmet_port_id = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] osapi_max_limit = 1000 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] osapi_volume_ext_list = [] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] osapi_volume_listen_port = 8776 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] osapi_volume_use_ssl = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] osapi_volume_workers = 2 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] per_volume_size_limit = -1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] periodic_fuzzy_delay = 60 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] periodic_interval = 60 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] public_endpoint = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] publish_errors = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] quota_backup_gigabytes = 1000 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] quota_backups = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] quota_gigabytes = 1000 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] quota_groups = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] quota_snapshots = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] quota_volumes = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] rate_limit_burst = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] rate_limit_except_level = CRITICAL {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] rate_limit_interval = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] reinit_driver_count = 3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] replication_device = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] report_discard_supported = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] report_interval = 120 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] reservation_clean_interval = 86400 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] reservation_expire = 86400 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] reserved_image_namespaces = [] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] reserved_percentage = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] rpc_response_timeout = 120 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] run_external_periodic_tasks = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] scst_target_driver = iscsi {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] scst_target_iqn_name = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] service_down_time = 720 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] shell_completion = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] snapshot_name_template = snapshot-%s {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] split_loggers = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] state_path = /opt/stack/data/cinder {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] storage_availability_zone = nova {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] storage_protocol = iSCSI {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] syslog_log_facility = LOG_USER {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] target_helper = lioadm {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] target_ip_address = 192.168.122.130 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] target_port = 3260 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] target_protocol = iscsi {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] target_secondary_ip_addresses = [] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] trace_flags = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] transport_url = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] until_refresh = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] use_chap_auth = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81957) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] use_default_quota_class = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] use_journal = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] use_json = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] use_multipath_for_image_xfer = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] use_stderr = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] use_syslog = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] verify_glance_signatures = enabled {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] volume_api_class = cinder.volume.api.API {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] volume_backend_name = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] volume_clear = zero {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] volume_clear_ionice = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] volume_clear_size = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] volume_copy_bps_limit = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] volume_dd_blocksize = 1M {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] volume_name_template = volume-%s {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] volume_service_inithost_offload = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] volume_usage_audit_period = month {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] zoning_mode = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_concurrency.disable_process_locking = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.admin_password = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.admin_token = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.admin_user = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.auth_port = 35357 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.auth_protocol = https {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.auth_section = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.auth_type = password {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.auth_uri = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.auth_version = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.cache = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.certfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.identity_uri = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.include_service_catalog = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.insecure = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.interface = public {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.keyfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.memcache_password = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.memcache_username = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.region_name = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.service_type = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.130/identity {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.backend = dogpile.cache.null {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.backend_argument = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.backend_expiration_time = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.config_prefix = cache.oslo {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.debug_cache_backend = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.enable_retry_client = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.enable_socket_keepalive = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.enabled = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.enforce_fips_mode = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.expiration_time = 600 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.hashclient_retry_attempts = 2 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.memcache_dead_retry = 300 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.memcache_pool_maxsize = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.memcache_sasl_enabled = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.password = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.proxies = [] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.redis_db = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.redis_server = localhost:6379 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.retry_attempts = 2 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.retry_delay = 0.0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.socket_keepalive_count = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.socket_keepalive_idle = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.socket_keepalive_interval = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.socket_timeout = 1.0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.tls_allowed_ciphers = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.tls_cafile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.tls_certfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.tls_enabled = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.tls_keyfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cache.username = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] coordination.backend_url = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] database.asyncio_connection = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] database.asyncio_slave_connection = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] database.backend = sqlalchemy {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] database.connection = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] database.connection_debug = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] database.connection_parameters = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] database.connection_recycle_time = 3600 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] database.connection_trace = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] database.db_inc_retry_interval = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] database.db_max_retries = 20 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] database.db_max_retry_interval = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] database.db_retry_interval = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] database.max_overflow = 50 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] database.max_pool_size = 5 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] database.max_retries = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] database.mysql_wsrep_sync_wait = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] database.pool_timeout = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] database.retry_interval = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] database.slave_connection = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] database.sqlite_synchronous = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] database.synchronous_reader = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] database.use_db_reconnect = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] profiler.connection_string = messaging:// {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] profiler.enabled = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] profiler.es_doc_type = notification {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] profiler.es_scroll_size = 10000 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] profiler.es_scroll_time = 2m {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] profiler.filter_error_trace = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] profiler.hmac_keys = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] profiler.sentinel_service_name = mymaster {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] profiler.socket_timeout = 0.1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] profiler.trace_requests = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] profiler.trace_sqlalchemy = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] profiler_jaeger.process_tags = {} {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] profiler_jaeger.service_name_prefix = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] profiler_otlp.service_name_prefix = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_policy.enforce_new_defaults = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: WARNING oslo_config.cfg [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_policy.enforce_scope = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_policy.policy_default_rule = default {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_policy.policy_file = policy.yaml {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] privsep_osbrick.group = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] privsep_osbrick.helper_command = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] privsep_osbrick.user = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cinder_sys_admin.group = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cinder_sys_admin.helper_command = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] cinder_sys_admin.user = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] service_user.auth_section = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] service_user.auth_type = password {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] service_user.cafile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] service_user.certfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] service_user.collect_timing = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] service_user.insecure = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] service_user.keyfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] service_user.send_service_user_token = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] service_user.split_loggers = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] service_user.timeout = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] glance.auth_section = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] glance.auth_type = password {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] glance.certfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] glance.collect_timing = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] glance.insecure = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] glance.keyfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] glance.region_name = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] glance.split_loggers = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] glance.timeout = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.backend_availability_zone = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.chap_password = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.chap_username = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.disk_geometry = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.driver_client_cert = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.driver_client_cert_key = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.driver_data_namespace = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.driver_use_ssl = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.extra_capabilities = {} {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.filter_function = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.goodness_function = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.iscsi_target_flags = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.iscsi_write_cache = on {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.iser_helper = tgtadm {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.iser_ip_address = 192.168.122.130 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.iser_port = 3260 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.nas_host = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.nas_login = admin {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.nas_mount_options = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.nas_password = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.nas_private_key = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.nas_share_path = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.num_shell_tries = 3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.quobyte_volume_url = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.replication_device = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.report_discard_supported = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.reserved_percentage = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.target_helper = tgtadm {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.target_ip_address = 192.168.122.130 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.target_port = 3260 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.target_protocol = iscsi {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.trace_flags = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.unique_fqdn_network = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.use_chap_auth = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.volume_backend_name = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.volume_clear = zero {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.volume_clear_ionice = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.volume_clear_size = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_reports.file_event_handler = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_reports.log_dir = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.backend_availability_zone = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.backend_host = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.chap_password = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.chap_username = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.chiscsi_conf = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.disk_geometry = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.driver_client_cert = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.driver_data_namespace = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.driver_use_ssl = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.extra_capabilities = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.filter_function = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.goodness_function = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.iser_helper = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.iser_ip_address = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.iser_port = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.iser_target_prefix = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.nas_host = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.nas_login = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.nas_mount_options = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.nas_password = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.nas_private_key = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.nas_share_path = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.nas_ssh_port = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.num_shell_tries = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81957) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 21 20:50:41 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.quobyte [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 21 20:50:41 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.quobyte [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.nvmet_port_id = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Running cmd (subprocess): mount.quobyte {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.replication_device = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.report_discard_supported = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.reserved_percentage = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.scst_target_driver = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.storage_protocol = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.target_helper = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.target_ip_address = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.target_port = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.target_prefix = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.target_protocol = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.trace_flags = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.use_chap_auth = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.volume_clear = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.volume_clear_size = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] QuobyteHD.volumes_dir = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.ssl = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_notifications.driver = [] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_notifications.retry = -1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] key_manager.fixed_key = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican.barbican_api_version = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican.barbican_endpoint = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican.barbican_endpoint_type = public {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican.barbican_region_name = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican.cafile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican.certfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican.collect_timing = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican.insecure = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican.keyfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican.number_of_retries = 60 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican.retry_delay = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican.send_service_user_token = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican.split_loggers = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican.timeout = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican.verify_ssl = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican.verify_ssl_path = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican_service_user.auth_section = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican_service_user.auth_type = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican_service_user.cafile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican_service_user.certfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican_service_user.collect_timing = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican_service_user.insecure = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican_service_user.keyfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican_service_user.split_loggers = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] barbican_service_user.timeout = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] vault.approle_role_id = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] vault.approle_secret_id = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] vault.kv_mountpoint = secret {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] vault.kv_path = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] vault.kv_version = 2 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] vault.namespace = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] vault.root_token_id = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] vault.ssl_ca_crt_file = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] vault.timeout = 60.0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] vault.use_ssl = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:41 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-bca3c3b6-29a0-49da-8973-230666d92239 None None] ******************************************************************************** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 21 20:50:42 devstack quobyte-client[81965]: Reading configuration file: /etc/quobyte/client.cfg Apr 21 20:50:42 devstack quobyte-client[81965]: Invalid parameters found, error: missing mount point. Apr 21 20:50:42 devstack quobyte-client[81965]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 21 20:50:42 devstack quobyte-client[81965]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 21 20:50:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] CMD "mount.quobyte" returned: 1 in 0.116s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:50:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:50:42 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:50:42 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:50:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:50:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:42 devstack sudo[81982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:50:42 devstack sudo[81982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:50:42 devstack sudo[81982]: pam_unix(sudo:session): session closed for user root Apr 21 20:50:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.779s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:42 devstack cinder-volume[81957]: INFO cinder.volume.driver [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Driver hasn't implemented _init_vendor_properties() Apr 21 20:50:42 devstack cinder-volume[81957]: DEBUG cinder.volume.driver [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327842712402, 'free_capacity_gb': 1775.7327842712402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81957) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 21 20:50:42 devstack cinder-volume[81957]: DEBUG oslo_db.sqlalchemy.engines [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81957) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:50:42 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writer thread running {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:50:42 devstack cinder-volume[81957]: DEBUG cinder.db.sqlalchemy.api [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Building query based on filter {{(pid=81957) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 21 20:50:42 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81957) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 21 20:50:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:50:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:50:42 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:50:42 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:50:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:50:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:42 devstack cinder-volume[81957]: INFO cinder.keymgr.migration [None req-3781a119-9e79-4f3d-99d2-28472b204abc None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 21 20:50:42 devstack sudo[82050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:50:42 devstack sudo[82050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:50:43 devstack sudo[82050]: pam_unix(sudo:session): session closed for user root Apr 21 20:50:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.452s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:43 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:50:43 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Driver initialization completed successfully. Apr 21 20:50:43 devstack cinder-volume[81957]: INFO cinder.manager [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Initiating service 3 cleanup Apr 21 20:50:43 devstack cinder-volume[81957]: INFO cinder.manager [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Service 3 cleanup completed. Apr 21 20:50:43 devstack cinder-volume[81957]: DEBUG cinder.service [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Creating RPC server for service cinder-volume {{(pid=81957) start /opt/stack/cinder/cinder/service.py:231}} Apr 21 20:50:43 devstack cinder-volume[81957]: DEBUG cinder.service [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81957) start /opt/stack/cinder/cinder/service.py:237}} Apr 21 20:50:43 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 21 20:50:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:50:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:50:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:50:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:50:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:50:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:43 devstack sudo[82063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:50:43 devstack sudo[82063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:50:43 devstack sudo[82063]: pam_unix(sudo:session): session closed for user root Apr 21 20:50:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.401s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:43 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-dedae454-e8d5-4adc-b917-56a62167fa65 None None] Driver post RPC initialization completed successfully. Apr 21 20:50:51 devstack cinder-volume[81813]: DEBUG dbcounter [-] [81813] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81813) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:50:53 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:SELECT=2 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:50:53 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:51:42 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Flow 'volume_create_manager' (34efcacd-e8c6-47f4-9662-6a1f27b1a294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b82ad4-ca96-4058-8deb-e8662d3b1dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b82ad4-ca96-4058-8deb-e8662d3b1dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1964903728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86cbf9ac-f53a-4740-a111-cdc9f716cae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0df5970527694c04b2e95cba027268f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:51:43Z,use_quota=True,user_id='035ffc401afa48a8a82c69331f1fab83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f34e87e-48ee-485b-a802-70b9eec2cc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f34e87e-48ee-485b-a802-70b9eec2cc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc5a2628-d4a4-455f-b0fe-5967fd21e9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc5a2628-d4a4-455f-b0fe-5967fd21e9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86cbf9ac-f53a-4740-a111-cdc9f716cae9', 'volume_name': 'volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8332a9e-1ee4-4a24-acfa-c74fe568d11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8332a9e-1ee4-4a24-acfa-c74fe568d11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1beeed-8406-4346-ba66-23c3c709ba3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:43 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Volume 86cbf9ac-f53a-4740-a111-cdc9f716cae9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9', 'volume_size': 1} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1964903728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86cbf9ac-f53a-4740-a111-cdc9f716cae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0df5970527694c04b2e95cba027268f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:51:43Z,use_quota=True,user_id='035ffc401afa48a8a82c69331f1fab83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Creating volume 86cbf9ac-f53a-4740-a111-cdc9f716cae9 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:51:43 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:43 devstack sudo[82361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9 1073741824 Apr 21 20:51:43 devstack sudo[82361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Flow 'volume_create_manager' (136831e5-03b0-4af2-b2db-c89308af1587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1f8d40-5334-4580-bd5c-33a3920a2ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1f8d40-5334-4580-bd5c-33a3920a2ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1283527852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d63662d-a72b-4d8c-a929-9b61afdbaeb1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='895275cc1ab8424391ffc8405b1cc222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:51:43Z,use_quota=True,user_id='5da4a77a297f4644bf9d851d1fd4c416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afae23b3-da8e-4500-ae99-bc1bb23e1f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afae23b3-da8e-4500-ae99-bc1bb23e1f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa66cd9-45d8-4b0b-80bc-b12d5152cb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa66cd9-45d8-4b0b-80bc-b12d5152cb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d63662d-a72b-4d8c-a929-9b61afdbaeb1', 'volume_name': 'volume-6d63662d-a72b-4d8c-a929-9b61afdbaeb1', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a96e17f-57a6-4c74-887c-18b6ad31524d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a96e17f-57a6-4c74-887c-18b6ad31524d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d58b2b-5edd-4051-9ce7-d4f844a1388b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:43 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Volume 6d63662d-a72b-4d8c-a929-9b61afdbaeb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d63662d-a72b-4d8c-a929-9b61afdbaeb1', 'volume_size': 1} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Flow 'volume_create_manager' (0c3f6f72-1c5e-47e8-957e-b3fed2c4e399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c47f14-9a94-444b-8f87-6cfb48c940c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c47f14-9a94-444b-8f87-6cfb48c940c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-852543582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820668f7-2ad3-4077-bd16-19f5fc7ecc72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6facd01269a403896cbf06cd52a6837',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:51:43Z,use_quota=True,user_id='3c970ccd47a5442cadf02123d95891cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e998f12-0d42-4d11-bdac-80bdbb7fbcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e998f12-0d42-4d11-bdac-80bdbb7fbcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c377a6-a2f0-4365-a58e-c69e36e48f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c377a6-a2f0-4365-a58e-c69e36e48f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '820668f7-2ad3-4077-bd16-19f5fc7ecc72', 'volume_name': 'volume-820668f7-2ad3-4077-bd16-19f5fc7ecc72', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d92eda2-4cab-45ca-abec-e71de15f9282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d92eda2-4cab-45ca-abec-e71de15f9282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6ca3ca-4e1f-4fc4-a5ed-0d69d892aed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:43 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Volume 820668f7-2ad3-4077-bd16-19f5fc7ecc72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-820668f7-2ad3-4077-bd16-19f5fc7ecc72', 'volume_size': 1} Apr 21 20:51:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:44 devstack sudo[82361]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9 1073741824" returned: 0 in 0.845s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:44 devstack sudo[82683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9 Apr 21 20:51:44 devstack sudo[82683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:44 devstack sudo[82683]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9" returned: 0 in 0.509s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:44 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:51:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.189s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:44 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1283527852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d63662d-a72b-4d8c-a929-9b61afdbaeb1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='895275cc1ab8424391ffc8405b1cc222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:51:43Z,use_quota=True,user_id='5da4a77a297f4644bf9d851d1fd4c416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:51:44 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Creating volume 6d63662d-a72b-4d8c-a929-9b61afdbaeb1 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:51:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:44 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:51:44 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:51:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:44 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:51:44 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:51:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6d63662d-a72b-4d8c-a929-9b61afdbaeb1 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1beeed-8406-4346-ba66-23c3c709ba3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:44 devstack sudo[82690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6d63662d-a72b-4d8c-a929-9b61afdbaeb1 1073741824 Apr 21 20:51:44 devstack sudo[82690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c66f46-a0b0-4dc3-864b-7b47795cec1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:44 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Volume volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9 (86cbf9ac-f53a-4740-a111-cdc9f716cae9): created successfully Apr 21 20:51:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c66f46-a0b0-4dc3-864b-7b47795cec1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Flow 'volume_create_manager' (34efcacd-e8c6-47f4-9662-6a1f27b1a294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:51:44 devstack cinder-volume[81957]: INFO cinder.volume.manager [req-1039a38c-e482-4ecf-b7bb-be88b6edbecd req-058df19b-174a-473c-bd67-2ed59353d712 tempest-VolumesSnapshotsTestJSON-1740089269 None] Created volume successfully. Apr 21 20:51:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-7da6e1ab-37ce-4545-a832-32209a289195 req-faed2c40-414a-47cb-a506-5e774e2169fe tempest-VolumesSnapshotsTestJSON-1740089269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:45 devstack sudo[82690]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6d63662d-a72b-4d8c-a929-9b61afdbaeb1 1073741824" returned: 0 in 0.727s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6d63662d-a72b-4d8c-a929-9b61afdbaeb1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:45 devstack sudo[82712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6d63662d-a72b-4d8c-a929-9b61afdbaeb1 Apr 21 20:51:45 devstack sudo[82712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:45 devstack sudo[82712]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6d63662d-a72b-4d8c-a929-9b61afdbaeb1" returned: 0 in 0.434s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:45 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:51:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.230s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:45 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-852543582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820668f7-2ad3-4077-bd16-19f5fc7ecc72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6facd01269a403896cbf06cd52a6837',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:51:43Z,use_quota=True,user_id='3c970ccd47a5442cadf02123d95891cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:51:45 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Creating volume 820668f7-2ad3-4077-bd16-19f5fc7ecc72 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:51:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:45 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:51:45 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:51:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:45 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:51:45 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:51:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-820668f7-2ad3-4077-bd16-19f5fc7ecc72 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d58b2b-5edd-4051-9ce7-d4f844a1388b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d63662d-a72b-4d8c-a929-9b61afdbaeb1', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:45 devstack sudo[82721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-820668f7-2ad3-4077-bd16-19f5fc7ecc72 1073741824 Apr 21 20:51:45 devstack sudo[82721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ab9878-f2d1-4f80-b660-82270ca52522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:45 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Volume volume-6d63662d-a72b-4d8c-a929-9b61afdbaeb1 (6d63662d-a72b-4d8c-a929-9b61afdbaeb1): created successfully Apr 21 20:51:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ab9878-f2d1-4f80-b660-82270ca52522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Flow 'volume_create_manager' (136831e5-03b0-4af2-b2db-c89308af1587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:51:45 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-1fad869e-78bd-46a1-a7e9-e4ed9fa039b0 tempest-VolumesTestJSON-356124756 None] Created volume successfully. Apr 21 20:51:46 devstack sudo[82721]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-820668f7-2ad3-4077-bd16-19f5fc7ecc72 1073741824" returned: 0 in 0.519s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-820668f7-2ad3-4077-bd16-19f5fc7ecc72 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:46 devstack sudo[82727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-820668f7-2ad3-4077-bd16-19f5fc7ecc72 Apr 21 20:51:46 devstack sudo[82727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:46 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:51:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Flow 'volume_create_manager' (ff721aef-835d-4ace-80a5-5d195561fe10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:51:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b16f9b-bbc1-4c27-ba96-51f7ade74216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b16f9b-bbc1-4c27-ba96-51f7ade74216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2025920100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b4226e-837b-4c90-8a4d-0e90df1f93f6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='895275cc1ab8424391ffc8405b1cc222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:51:46Z,use_quota=True,user_id='5da4a77a297f4644bf9d851d1fd4c416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a625da6e-2f95-4684-9f82-b270119d3c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a625da6e-2f95-4684-9f82-b270119d3c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8805f3a7-28f2-41a8-88da-09858871002b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8805f3a7-28f2-41a8-88da-09858871002b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8b4226e-837b-4c90-8a4d-0e90df1f93f6', 'volume_name': 'volume-a8b4226e-837b-4c90-8a4d-0e90df1f93f6', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9023f72-d100-46d2-96a4-a3bb278d3f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9023f72-d100-46d2-96a4-a3bb278d3f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43761170-e44e-40c6-841c-c85a083da231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:46 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Volume a8b4226e-837b-4c90-8a4d-0e90df1f93f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8b4226e-837b-4c90-8a4d-0e90df1f93f6', 'volume_size': 1} Apr 21 20:51:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:46 devstack sudo[82727]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-820668f7-2ad3-4077-bd16-19f5fc7ecc72" returned: 0 in 0.428s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:51:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-7da6e1ab-37ce-4545-a832-32209a289195 req-faed2c40-414a-47cb-a506-5e774e2169fe tempest-VolumesSnapshotsTestJSON-1740089269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.735s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6ca3ca-4e1f-4fc4-a5ed-0d69d892aed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-820668f7-2ad3-4077-bd16-19f5fc7ecc72', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe08933a-eee5-459c-9a1e-03bc0cf48e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [req-7da6e1ab-37ce-4545-a832-32209a289195 req-faed2c40-414a-47cb-a506-5e774e2169fe tempest-VolumesSnapshotsTestJSON-1740089269 None] Creating offline snapshot 4d61ea34-5594-4b25-98da-db028640ca40 of volume 86cbf9ac-f53a-4740-a111-cdc9f716cae9 {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:51:46 devstack cinder-volume[81957]: INFO oslo.privsep.daemon [req-7da6e1ab-37ce-4545-a832-32209a289195 req-faed2c40-414a-47cb-a506-5e774e2169fe tempest-VolumesSnapshotsTestJSON-1740089269 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp9wb6as3u/privsep.sock'] Apr 21 20:51:46 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Volume volume-820668f7-2ad3-4077-bd16-19f5fc7ecc72 (820668f7-2ad3-4077-bd16-19f5fc7ecc72): created successfully Apr 21 20:51:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe08933a-eee5-459c-9a1e-03bc0cf48e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Flow 'volume_create_manager' (0c3f6f72-1c5e-47e8-957e-b3fed2c4e399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:51:46 devstack sudo[82734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp9wb6as3u/privsep.sock Apr 21 20:51:46 devstack sudo[82734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:46 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-7dc447bd-fb88-4cf3-b51d-0bcb6e832f73 tempest-DeleteServersTestJSON-1337914727 None] Created volume successfully. Apr 21 20:51:47 devstack cinder-volume[81957]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 21 20:51:47 devstack cinder-volume[81957]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 20:51:47 devstack cinder-volume[81957]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 21 20:51:47 devstack cinder-volume[81957]: WARNING oslo.privsep.daemon [-] privsep log: Apr 21 20:51:47 devstack cinder-volume[81957]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 21 20:51:47 devstack cinder-volume[81957]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 21 20:51:47 devstack cinder-volume[81957]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 20:51:47 devstack cinder-volume[81957]: WARNING oslo.privsep.daemon [-] privsep log: Apr 21 20:51:47 devstack cinder-volume[81957]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 21 20:51:47 devstack cinder-volume[81957]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 21 20:51:47 devstack cinder-volume[81957]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 20:51:47 devstack cinder-volume[81957]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 21 20:51:47 devstack cinder-volume[81957]: WARNING oslo.privsep.daemon [-] privsep log: Apr 21 20:51:47 devstack cinder-volume[81957]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 21 20:51:47 devstack cinder-volume[81957]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 21 20:51:47 devstack cinder-volume[81957]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 20:51:47 devstack cinder-volume[81957]: WARNING oslo.privsep.daemon [-] privsep log: Apr 21 20:51:47 devstack cinder-volume[81957]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 21 20:51:47 devstack sudo[82734]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:47 devstack cinder-volume[81957]: INFO oslo.privsep.daemon [req-7da6e1ab-37ce-4545-a832-32209a289195 req-faed2c40-414a-47cb-a506-5e774e2169fe tempest-VolumesSnapshotsTestJSON-1740089269 None] Spawned new privsep daemon via rootwrap Apr 21 20:51:47 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [req-7da6e1ab-37ce-4545-a832-32209a289195 req-faed2c40-414a-47cb-a506-5e774e2169fe tempest-VolumesSnapshotsTestJSON-1740089269 None] Accepted privsep connection to /tmp/tmp9wb6as3u/privsep.sock {{(pid=81957) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 21 20:51:47 devstack cinder-volume[81957]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 21 20:51:47 devstack cinder-volume[81957]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 21 20:51:47 devstack cinder-volume[81957]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 21 20:51:47 devstack cinder-volume[81957]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82748 Apr 21 20:51:47 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b86fa3-546b-4311-8218-78219149ddc2]: (2,) {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:47 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a0b31c-6eab-49f4-b7a3-b449c6219442]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-7da6e1ab-37ce-4545-a832-32209a289195 req-faed2c40-414a-47cb-a506-5e774e2169fe tempest-VolumesSnapshotsTestJSON-1740089269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:47 devstack sudo[82750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9 Apr 21 20:51:47 devstack sudo[82750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:48 devstack sudo[82750]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-7da6e1ab-37ce-4545-a832-32209a289195 req-faed2c40-414a-47cb-a506-5e774e2169fe tempest-VolumesSnapshotsTestJSON-1740089269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9" returned: 0 in 0.466s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-7da6e1ab-37ce-4545-a832-32209a289195 req-faed2c40-414a-47cb-a506-5e774e2169fe tempest-VolumesSnapshotsTestJSON-1740089269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.4d61ea34-5594-4b25-98da-db028640ca40 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:48 devstack sudo[82757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.4d61ea34-5594-4b25-98da-db028640ca40 1G Apr 21 20:51:48 devstack sudo[82757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:48 devstack sudo[82757]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-7da6e1ab-37ce-4545-a832-32209a289195 req-faed2c40-414a-47cb-a506-5e774e2169fe tempest-VolumesSnapshotsTestJSON-1740089269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.4d61ea34-5594-4b25-98da-db028640ca40 1G" returned: 0 in 0.483s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-7da6e1ab-37ce-4545-a832-32209a289195 req-faed2c40-414a-47cb-a506-5e774e2169fe tempest-VolumesSnapshotsTestJSON-1740089269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.4d61ea34-5594-4b25-98da-db028640ca40 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:48 devstack sudo[82764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.4d61ea34-5594-4b25-98da-db028640ca40 Apr 21 20:51:48 devstack sudo[82764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:49 devstack sudo[82764]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-7da6e1ab-37ce-4545-a832-32209a289195 req-faed2c40-414a-47cb-a506-5e774e2169fe tempest-VolumesSnapshotsTestJSON-1740089269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.4d61ea34-5594-4b25-98da-db028640ca40" returned: 0 in 0.506s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:49 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [req-7da6e1ab-37ce-4545-a832-32209a289195 req-faed2c40-414a-47cb-a506-5e774e2169fe tempest-VolumesSnapshotsTestJSON-1740089269 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.4d61ea34-5594-4b25-98da-db028640ca40 is being set with open permissions: ugo+rw Apr 21 20:51:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-7da6e1ab-37ce-4545-a832-32209a289195 req-faed2c40-414a-47cb-a506-5e774e2169fe tempest-VolumesSnapshotsTestJSON-1740089269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.4d61ea34-5594-4b25-98da-db028640ca40 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:49 devstack sudo[82771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.4d61ea34-5594-4b25-98da-db028640ca40 Apr 21 20:51:49 devstack sudo[82771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:49 devstack sudo[82771]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-7da6e1ab-37ce-4545-a832-32209a289195 req-faed2c40-414a-47cb-a506-5e774e2169fe tempest-VolumesSnapshotsTestJSON-1740089269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.4d61ea34-5594-4b25-98da-db028640ca40" returned: 0 in 0.522s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-7da6e1ab-37ce-4545-a832-32209a289195 req-faed2c40-414a-47cb-a506-5e774e2169fe tempest-VolumesSnapshotsTestJSON-1740089269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:49 devstack sudo[82779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.info Apr 21 20:51:49 devstack sudo[82779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:50 devstack sudo[82779]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-7da6e1ab-37ce-4545-a832-32209a289195 req-faed2c40-414a-47cb-a506-5e774e2169fe tempest-VolumesSnapshotsTestJSON-1740089269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.info" returned: 0 in 0.470s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:50 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [req-7da6e1ab-37ce-4545-a832-32209a289195 req-faed2c40-414a-47cb-a506-5e774e2169fe tempest-VolumesSnapshotsTestJSON-1740089269 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.info is being set with open permissions: ugo+rw Apr 21 20:51:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-7da6e1ab-37ce-4545-a832-32209a289195 req-faed2c40-414a-47cb-a506-5e774e2169fe tempest-VolumesSnapshotsTestJSON-1740089269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:50 devstack sudo[82786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.info Apr 21 20:51:50 devstack sudo[82786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:50 devstack sudo[82786]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-7da6e1ab-37ce-4545-a832-32209a289195 req-faed2c40-414a-47cb-a506-5e774e2169fe tempest-VolumesSnapshotsTestJSON-1740089269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.info" returned: 0 in 0.482s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-7da6e1ab-37ce-4545-a832-32209a289195 req-faed2c40-414a-47cb-a506-5e774e2169fe tempest-VolumesSnapshotsTestJSON-1740089269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.042s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.219s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:50 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2025920100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b4226e-837b-4c90-8a4d-0e90df1f93f6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='895275cc1ab8424391ffc8405b1cc222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:51:46Z,use_quota=True,user_id='5da4a77a297f4644bf9d851d1fd4c416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:51:50 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Creating volume a8b4226e-837b-4c90-8a4d-0e90df1f93f6 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:51:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:50 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:51:50 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:51:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:50 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:51:50 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:51:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8b4226e-837b-4c90-8a4d-0e90df1f93f6 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:50 devstack sudo[82793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8b4226e-837b-4c90-8a4d-0e90df1f93f6 1073741824 Apr 21 20:51:50 devstack sudo[82793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:50 devstack cinder-volume[81957]: INFO cinder.volume.manager [req-7da6e1ab-37ce-4545-a832-32209a289195 req-faed2c40-414a-47cb-a506-5e774e2169fe tempest-VolumesSnapshotsTestJSON-1740089269 None] Create snapshot completed successfully Apr 21 20:51:51 devstack sudo[82793]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8b4226e-837b-4c90-8a4d-0e90df1f93f6 1073741824" returned: 0 in 0.499s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8b4226e-837b-4c90-8a4d-0e90df1f93f6 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:51 devstack sudo[82811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8b4226e-837b-4c90-8a4d-0e90df1f93f6 Apr 21 20:51:51 devstack sudo[82811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] Acquiring lock "cinder-4d61ea34-5594-4b25-98da-db028640ca40-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] Lock "cinder-4d61ea34-5594-4b25-98da-db028640ca40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] Acquiring lock "cinder-quobyte-86cbf9ac-f53a-4740-a111-cdc9f716cae9" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] Lock "cinder-quobyte-86cbf9ac-f53a-4740-a111-cdc9f716cae9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] Acquiring lock "cinder-quobyte-4d61ea34-5594-4b25-98da-db028640ca40" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] Lock "cinder-quobyte-4d61ea34-5594-4b25-98da-db028640ca40" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:51 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] Deleting offline snapshot 4d61ea34-5594-4b25-98da-db028640ca40 of volume 86cbf9ac-f53a-4740-a111-cdc9f716cae9 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:51:51 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] snapshot_file for this snap is: volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.4d61ea34-5594-4b25-98da-db028640ca40 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:51:51 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cdf869-8c13-4531-995d-72ff0431a7e0]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.4d61ea34-5594-4b25-98da-db028640ca40 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:51 devstack sudo[82811]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8b4226e-837b-4c90-8a4d-0e90df1f93f6" returned: 0 in 0.436s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:51 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:51:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:51 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43761170-e44e-40c6-841c-c85a083da231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8b4226e-837b-4c90-8a4d-0e90df1f93f6', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:51 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb61bdf-4a71-41c8-9361-d66026f758c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:51 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Volume volume-a8b4226e-837b-4c90-8a4d-0e90df1f93f6 (a8b4226e-837b-4c90-8a4d-0e90df1f93f6): created successfully Apr 21 20:51:51 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb61bdf-4a71-41c8-9361-d66026f758c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:51 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Flow 'volume_create_manager' (ff721aef-835d-4ace-80a5-5d195561fe10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:51:51 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-2dd5c8c3-670c-44f7-9399-547872181f51 tempest-VolumesTestJSON-356124756 None] Created volume successfully. Apr 21 20:51:51 devstack sudo[82830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.4d61ea34-5594-4b25-98da-db028640ca40 Apr 21 20:51:51 devstack sudo[82830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:51 devstack cinder-volume[81957]: WARNING py.warnings [req-ddcbdd93-a857-454d-90b3-b095f10e6cc3 req-fa25500f-7cb4-4c37-bbf7-4c7e13fc1e9f tempest-DeleteServersTestJSON-1337914727 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 21 20:51:51 devstack cinder-volume[81957]: .first() Apr 21 20:51:51 devstack cinder-volume[81957]: Apr 21 20:51:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-ddcbdd93-a857-454d-90b3-b095f10e6cc3 req-fa25500f-7cb4-4c37-bbf7-4c7e13fc1e9f tempest-DeleteServersTestJSON-1337914727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-ddcbdd93-a857-454d-90b3-b095f10e6cc3 req-fa25500f-7cb4-4c37-bbf7-4c7e13fc1e9f tempest-DeleteServersTestJSON-1337914727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:51 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c907178-bab7-4b8b-a225-57085f42b1be]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-ddcbdd93-a857-454d-90b3-b095f10e6cc3 req-fa25500f-7cb4-4c37-bbf7-4c7e13fc1e9f tempest-DeleteServersTestJSON-1337914727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-820668f7-2ad3-4077-bd16-19f5fc7ecc72 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:51 devstack sudo[82833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-820668f7-2ad3-4077-bd16-19f5fc7ecc72 Apr 21 20:51:51 devstack sudo[82833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:52 devstack sudo[82830]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.4d61ea34-5594-4b25-98da-db028640ca40" returned: 0 in 0.471s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:52 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:51:52 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a962fd-29d2-44b3-899f-d36b37ef39ad]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:52 devstack sudo[82840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9 Apr 21 20:51:52 devstack sudo[82840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:52 devstack sudo[82833]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-ddcbdd93-a857-454d-90b3-b095f10e6cc3 req-fa25500f-7cb4-4c37-bbf7-4c7e13fc1e9f tempest-DeleteServersTestJSON-1337914727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-820668f7-2ad3-4077-bd16-19f5fc7ecc72" returned: 0 in 0.453s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-ddcbdd93-a857-454d-90b3-b095f10e6cc3 req-fa25500f-7cb4-4c37-bbf7-4c7e13fc1e9f tempest-DeleteServersTestJSON-1337914727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.462s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-ddcbdd93-a857-454d-90b3-b095f10e6cc3 req-fa25500f-7cb4-4c37-bbf7-4c7e13fc1e9f tempest-DeleteServersTestJSON-1337914727 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7', 'name': 'volume-820668f7-2ad3-4077-bd16-19f5fc7ecc72', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b837c0e-3ad6-4d09-93d2-d9205c345027', 'enforce_multipath': True} {{(pid=81957) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 21 20:51:52 devstack cinder-volume[81957]: INFO cinder.volume.manager [req-ddcbdd93-a857-454d-90b3-b095f10e6cc3 req-fa25500f-7cb4-4c37-bbf7-4c7e13fc1e9f tempest-DeleteServersTestJSON-1337914727 None] attachment_update completed successfully. Apr 21 20:51:52 devstack sudo[82840]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9" returned: 0 in 0.445s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.4d61ea34-5594-4b25-98da-db028640ca40 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:52 devstack sudo[82847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.4d61ea34-5594-4b25-98da-db028640ca40 Apr 21 20:51:52 devstack sudo[82847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:53 devstack sudo[82847]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.4d61ea34-5594-4b25-98da-db028640ca40" returned: 0 in 0.544s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.4d61ea34-5594-4b25-98da-db028640ca40 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:53 devstack sudo[82919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.4d61ea34-5594-4b25-98da-db028640ca40 Apr 21 20:51:53 devstack sudo[82919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Flow 'volume_create_manager' (f94b8b49-6740-4026-b610-04417d95eb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b8c1b4-a576-43b1-a145-d65e002fc6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b8c1b4-a576-43b1-a145-d65e002fc6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1011926191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ef53bd-1566-4f42-a817-3f9cf82ce24c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='895275cc1ab8424391ffc8405b1cc222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:51:53Z,use_quota=True,user_id='5da4a77a297f4644bf9d851d1fd4c416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e1701f-e3ed-48c4-a0b3-ea4a16e09318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e1701f-e3ed-48c4-a0b3-ea4a16e09318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba018356-8acf-4e0c-abf2-c6f0a863432a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba018356-8acf-4e0c-abf2-c6f0a863432a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70ef53bd-1566-4f42-a817-3f9cf82ce24c', 'volume_name': 'volume-70ef53bd-1566-4f42-a817-3f9cf82ce24c', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018c5c6b-b6b9-48f9-b6fd-80af8f6bb89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018c5c6b-b6b9-48f9-b6fd-80af8f6bb89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2babc9b-991b-4d3e-9425-85fa53485f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:53 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Volume 70ef53bd-1566-4f42-a817-3f9cf82ce24c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70ef53bd-1566-4f42-a817-3f9cf82ce24c', 'volume_size': 1} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1011926191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ef53bd-1566-4f42-a817-3f9cf82ce24c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='895275cc1ab8424391ffc8405b1cc222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:51:53Z,use_quota=True,user_id='5da4a77a297f4644bf9d851d1fd4c416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Creating volume 70ef53bd-1566-4f42-a817-3f9cf82ce24c {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:51:53 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-70ef53bd-1566-4f42-a817-3f9cf82ce24c 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:53 devstack sudo[82924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-70ef53bd-1566-4f42-a817-3f9cf82ce24c 1073741824 Apr 21 20:51:53 devstack sudo[82924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:53 devstack sudo[82919]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9.4d61ea34-5594-4b25-98da-db028640ca40" returned: 0 in 0.414s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] Lock "cinder-quobyte-4d61ea34-5594-4b25-98da-db028640ca40" released by "_delete_snapshot" :: held 1.938s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] Lock "cinder-quobyte-86cbf9ac-f53a-4740-a111-cdc9f716cae9" released by "delete_snapshot" :: held 1.963s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:53 devstack cinder-volume[81957]: WARNING cinder.quota [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:51:53 devstack cinder-volume[81957]: WARNING cinder.quota [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.quota [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] Created reservations ['30718648-09eb-4981-8898-5e3f22cd5fb7', '17d1e626-df04-4cce-a6be-f699f7dd6ffd', '377b52b4-2cda-47f0-92b4-1448e9f9e859', 'f9989bc3-fcde-4e27-9ae9-e28b29034bfb'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:51:53 devstack cinder-volume[81957]: INFO cinder.volume.manager [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] Delete snapshot completed successfully. Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-71584579-f199-4337-8425-ad687186068c req-9568de9f-5589-485a-9d53-6af08e948f7c tempest-VolumesSnapshotsTestJSON-1740089269 None] Lock "cinder-4d61ea34-5594-4b25-98da-db028640ca40-delete_snapshot" released by "delete_snapshot" :: held 2.121s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG oslo_service.periodic_task [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81957) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:53 devstack sudo[83279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:51:53 devstack sudo[83279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:53 devstack sudo[82924]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-70ef53bd-1566-4f42-a817-3f9cf82ce24c 1073741824" returned: 0 in 0.581s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-70ef53bd-1566-4f42-a817-3f9cf82ce24c {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:53 devstack sudo[83282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-70ef53bd-1566-4f42-a817-3f9cf82ce24c Apr 21 20:51:53 devstack sudo[83282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-0d1912cd-5e07-4d89-bd84-6910ff575f30 req-72183cf9-341f-4586-b5fc-ab38aa43cec2 tempest-VolumesSnapshotsTestJSON-1740089269 None] Acquiring lock "cinder-86cbf9ac-f53a-4740-a111-cdc9f716cae9-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:53 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-0d1912cd-5e07-4d89-bd84-6910ff575f30 req-72183cf9-341f-4586-b5fc-ab38aa43cec2 tempest-VolumesSnapshotsTestJSON-1740089269 None] Lock "cinder-86cbf9ac-f53a-4740-a111-cdc9f716cae9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:54 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-0d1912cd-5e07-4d89-bd84-6910ff575f30 req-72183cf9-341f-4586-b5fc-ab38aa43cec2 tempest-VolumesSnapshotsTestJSON-1740089269 None] Acquiring lock "cinder-quobyte-86cbf9ac-f53a-4740-a111-cdc9f716cae9" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:54 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-0d1912cd-5e07-4d89-bd84-6910ff575f30 req-72183cf9-341f-4586-b5fc-ab38aa43cec2 tempest-VolumesSnapshotsTestJSON-1740089269 None] Lock "cinder-quobyte-86cbf9ac-f53a-4740-a111-cdc9f716cae9" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:54 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2769d1-976e-4084-8915-e65d0b63c8ac]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-0d1912cd-5e07-4d89-bd84-6910ff575f30 req-72183cf9-341f-4586-b5fc-ab38aa43cec2 tempest-VolumesSnapshotsTestJSON-1740089269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:54 devstack sudo[83286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9 Apr 21 20:51:54 devstack sudo[83286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:54 devstack sudo[83279]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.618s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:54 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:51:54 devstack sudo[83282]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-70ef53bd-1566-4f42-a817-3f9cf82ce24c" returned: 0 in 0.590s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:54 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:51:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:54 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2babc9b-991b-4d3e-9425-85fa53485f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ef53bd-1566-4f42-a817-3f9cf82ce24c', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:54 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a47246a-88be-4540-bbe3-2e979c318635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:54 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Volume volume-70ef53bd-1566-4f42-a817-3f9cf82ce24c (70ef53bd-1566-4f42-a817-3f9cf82ce24c): created successfully Apr 21 20:51:54 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a47246a-88be-4540-bbe3-2e979c318635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:54 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Flow 'volume_create_manager' (f94b8b49-6740-4026-b610-04417d95eb3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:51:54 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-0e7b657e-cf0e-42b4-9c9f-b0c314b29d9b tempest-VolumesTestJSON-356124756 None] Created volume successfully. Apr 21 20:51:54 devstack sudo[83286]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-0d1912cd-5e07-4d89-bd84-6910ff575f30 req-72183cf9-341f-4586-b5fc-ab38aa43cec2 tempest-VolumesSnapshotsTestJSON-1740089269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9" returned: 0 in 0.575s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-0d1912cd-5e07-4d89-bd84-6910ff575f30 req-72183cf9-341f-4586-b5fc-ab38aa43cec2 tempest-VolumesSnapshotsTestJSON-1740089269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:54 devstack sudo[83299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9 Apr 21 20:51:54 devstack sudo[83299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:55 devstack sudo[83299]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-0d1912cd-5e07-4d89-bd84-6910ff575f30 req-72183cf9-341f-4586-b5fc-ab38aa43cec2 tempest-VolumesSnapshotsTestJSON-1740089269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-86cbf9ac-f53a-4740-a111-cdc9f716cae9" returned: 0 in 0.421s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:55 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-0d1912cd-5e07-4d89-bd84-6910ff575f30 req-72183cf9-341f-4586-b5fc-ab38aa43cec2 tempest-VolumesSnapshotsTestJSON-1740089269 None] Lock "cinder-quobyte-86cbf9ac-f53a-4740-a111-cdc9f716cae9" released by "delete_volume" :: held 1.064s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:55 devstack cinder-volume[81957]: WARNING cinder.quota [req-0d1912cd-5e07-4d89-bd84-6910ff575f30 req-72183cf9-341f-4586-b5fc-ab38aa43cec2 tempest-VolumesSnapshotsTestJSON-1740089269 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:51:55 devstack cinder-volume[81957]: DEBUG cinder.quota [req-0d1912cd-5e07-4d89-bd84-6910ff575f30 req-72183cf9-341f-4586-b5fc-ab38aa43cec2 tempest-VolumesSnapshotsTestJSON-1740089269 None] Created reservations ['a541e978-6ec2-465d-8b6c-18b41f665370', 'd9e131fb-5f08-45a3-bb67-f8047103d979', '471e39c1-887b-454b-9f15-a11a238824bf', '09dd1f4d-6aca-4f0a-807b-1a60250a84ef'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:51:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-0d1912cd-5e07-4d89-bd84-6910ff575f30 req-72183cf9-341f-4586-b5fc-ab38aa43cec2 tempest-VolumesSnapshotsTestJSON-1740089269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-0d1912cd-5e07-4d89-bd84-6910ff575f30 req-72183cf9-341f-4586-b5fc-ab38aa43cec2 tempest-VolumesSnapshotsTestJSON-1740089269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-0d1912cd-5e07-4d89-bd84-6910ff575f30 req-72183cf9-341f-4586-b5fc-ab38aa43cec2 tempest-VolumesSnapshotsTestJSON-1740089269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:51:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-0d1912cd-5e07-4d89-bd84-6910ff575f30 req-72183cf9-341f-4586-b5fc-ab38aa43cec2 tempest-VolumesSnapshotsTestJSON-1740089269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:51:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-0d1912cd-5e07-4d89-bd84-6910ff575f30 req-72183cf9-341f-4586-b5fc-ab38aa43cec2 tempest-VolumesSnapshotsTestJSON-1740089269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-0d1912cd-5e07-4d89-bd84-6910ff575f30 req-72183cf9-341f-4586-b5fc-ab38aa43cec2 tempest-VolumesSnapshotsTestJSON-1740089269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:55 devstack sudo[83304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:51:55 devstack sudo[83304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:55 devstack sudo[83304]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-0d1912cd-5e07-4d89-bd84-6910ff575f30 req-72183cf9-341f-4586-b5fc-ab38aa43cec2 tempest-VolumesSnapshotsTestJSON-1740089269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.451s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:55 devstack cinder-volume[81957]: DEBUG cinder.manager [req-0d1912cd-5e07-4d89-bd84-6910ff575f30 req-72183cf9-341f-4586-b5fc-ab38aa43cec2 tempest-VolumesSnapshotsTestJSON-1740089269 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:51:55 devstack cinder-volume[81957]: INFO cinder.volume.manager [req-0d1912cd-5e07-4d89-bd84-6910ff575f30 req-72183cf9-341f-4586-b5fc-ab38aa43cec2 tempest-VolumesSnapshotsTestJSON-1740089269 None] Deleted volume successfully. Apr 21 20:51:55 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-0d1912cd-5e07-4d89-bd84-6910ff575f30 req-72183cf9-341f-4586-b5fc-ab38aa43cec2 tempest-VolumesSnapshotsTestJSON-1740089269 None] Lock "cinder-86cbf9ac-f53a-4740-a111-cdc9f716cae9-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:56 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-01a5f229-4292-4659-9adf-9dca06aef439 tempest-VolumesTestJSON-356124756 None] Acquiring lock "cinder-70ef53bd-1566-4f42-a817-3f9cf82ce24c-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:56 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-01a5f229-4292-4659-9adf-9dca06aef439 tempest-VolumesTestJSON-356124756 None] Lock "cinder-70ef53bd-1566-4f42-a817-3f9cf82ce24c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:56 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-01a5f229-4292-4659-9adf-9dca06aef439 tempest-VolumesTestJSON-356124756 None] Acquiring lock "cinder-quobyte-70ef53bd-1566-4f42-a817-3f9cf82ce24c" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:56 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-01a5f229-4292-4659-9adf-9dca06aef439 tempest-VolumesTestJSON-356124756 None] Lock "cinder-quobyte-70ef53bd-1566-4f42-a817-3f9cf82ce24c" acquired by "delete_volume" :: waited 0.016s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:56 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dd5576-3d14-4849-8c86-36a74ee6f205]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-01a5f229-4292-4659-9adf-9dca06aef439 tempest-VolumesTestJSON-356124756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-70ef53bd-1566-4f42-a817-3f9cf82ce24c {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:56 devstack sudo[83344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-70ef53bd-1566-4f42-a817-3f9cf82ce24c Apr 21 20:51:56 devstack sudo[83344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:57 devstack sudo[83344]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-01a5f229-4292-4659-9adf-9dca06aef439 tempest-VolumesTestJSON-356124756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-70ef53bd-1566-4f42-a817-3f9cf82ce24c" returned: 0 in 1.042s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-01a5f229-4292-4659-9adf-9dca06aef439 tempest-VolumesTestJSON-356124756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-70ef53bd-1566-4f42-a817-3f9cf82ce24c {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:57 devstack sudo[83352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-70ef53bd-1566-4f42-a817-3f9cf82ce24c Apr 21 20:51:57 devstack sudo[83352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:58 devstack sudo[83352]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-01a5f229-4292-4659-9adf-9dca06aef439 tempest-VolumesTestJSON-356124756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-70ef53bd-1566-4f42-a817-3f9cf82ce24c" returned: 0 in 0.639s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-01a5f229-4292-4659-9adf-9dca06aef439 tempest-VolumesTestJSON-356124756 None] Lock "cinder-quobyte-70ef53bd-1566-4f42-a817-3f9cf82ce24c" released by "delete_volume" :: held 1.785s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:58 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-01a5f229-4292-4659-9adf-9dca06aef439 tempest-VolumesTestJSON-356124756 None] Created reservations ['e52aa6bd-06f3-4bf2-9200-b6532dc2b58a', '71047c88-2f08-437c-bafc-7b33935535c3', '3900a8a4-5cf3-4a01-81ec-f143a5046b8e', '18dd3d1e-f5e6-4c1f-a282-aead16f3ba05'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:51:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-01a5f229-4292-4659-9adf-9dca06aef439 tempest-VolumesTestJSON-356124756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-01a5f229-4292-4659-9adf-9dca06aef439 tempest-VolumesTestJSON-356124756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-01a5f229-4292-4659-9adf-9dca06aef439 tempest-VolumesTestJSON-356124756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:51:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-01a5f229-4292-4659-9adf-9dca06aef439 tempest-VolumesTestJSON-356124756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:51:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-01a5f229-4292-4659-9adf-9dca06aef439 tempest-VolumesTestJSON-356124756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-01a5f229-4292-4659-9adf-9dca06aef439 tempest-VolumesTestJSON-356124756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:58 devstack sudo[83356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:51:58 devstack sudo[83356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a9d795d4-3a2a-4a24-8d74-541f49de4d5c tempest-VolumesTestJSON-356124756 None] Acquiring lock "cinder-a8b4226e-837b-4c90-8a4d-0e90df1f93f6-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a9d795d4-3a2a-4a24-8d74-541f49de4d5c tempest-VolumesTestJSON-356124756 None] Lock "cinder-a8b4226e-837b-4c90-8a4d-0e90df1f93f6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a9d795d4-3a2a-4a24-8d74-541f49de4d5c tempest-VolumesTestJSON-356124756 None] Acquiring lock "cinder-quobyte-a8b4226e-837b-4c90-8a4d-0e90df1f93f6" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a9d795d4-3a2a-4a24-8d74-541f49de4d5c tempest-VolumesTestJSON-356124756 None] Lock "cinder-quobyte-a8b4226e-837b-4c90-8a4d-0e90df1f93f6" acquired by "delete_volume" :: waited 0.017s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:58 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d955f0b-7d63-4f48-83a3-6443bf2f607b]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a9d795d4-3a2a-4a24-8d74-541f49de4d5c tempest-VolumesTestJSON-356124756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8b4226e-837b-4c90-8a4d-0e90df1f93f6 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:59 devstack sudo[83381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8b4226e-837b-4c90-8a4d-0e90df1f93f6 Apr 21 20:51:59 devstack sudo[83381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:59 devstack sudo[83356]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-01a5f229-4292-4659-9adf-9dca06aef439 tempest-VolumesTestJSON-356124756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.813s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:59 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-01a5f229-4292-4659-9adf-9dca06aef439 tempest-VolumesTestJSON-356124756 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:51:59 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-01a5f229-4292-4659-9adf-9dca06aef439 tempest-VolumesTestJSON-356124756 None] Deleted volume successfully. Apr 21 20:51:59 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-01a5f229-4292-4659-9adf-9dca06aef439 tempest-VolumesTestJSON-356124756 None] Lock "cinder-70ef53bd-1566-4f42-a817-3f9cf82ce24c-delete_volume" released by "delete_volume" :: held 2.791s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:59 devstack sudo[83381]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a9d795d4-3a2a-4a24-8d74-541f49de4d5c tempest-VolumesTestJSON-356124756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8b4226e-837b-4c90-8a4d-0e90df1f93f6" returned: 0 in 0.878s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a9d795d4-3a2a-4a24-8d74-541f49de4d5c tempest-VolumesTestJSON-356124756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8b4226e-837b-4c90-8a4d-0e90df1f93f6 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:59 devstack sudo[83413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8b4226e-837b-4c90-8a4d-0e90df1f93f6 Apr 21 20:51:59 devstack sudo[83413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:59 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Flow 'volume_create_manager' (97b8a8f3-6357-4c08-96e7-38db22828ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b49bdb9-d448-4261-a1fd-23eec38038f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b49bdb9-d448-4261-a1fd-23eec38038f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2095610473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=046073c2-261d-4e32-9c33-8914975968a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95de6f97e788493c914e122a607c7e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:00Z,use_quota=True,user_id='0ef77b796f3f4149a2a33463510f28cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd31c7b-04f2-4a9a-93be-a5dd8dd390f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd31c7b-04f2-4a9a-93be-a5dd8dd390f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47845c96-4ae5-48a5-b344-b2425c67449b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47845c96-4ae5-48a5-b344-b2425c67449b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '046073c2-261d-4e32-9c33-8914975968a9', 'volume_name': 'volume-046073c2-261d-4e32-9c33-8914975968a9', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f09aca0-865e-4513-87fc-07ed96879378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f09aca0-865e-4513-87fc-07ed96879378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941e1e8b-5b80-4d74-9606-48c254fc8dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:00 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Volume 046073c2-261d-4e32-9c33-8914975968a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-046073c2-261d-4e32-9c33-8914975968a9', 'volume_size': 1} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2095610473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=046073c2-261d-4e32-9c33-8914975968a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95de6f97e788493c914e122a607c7e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:00Z,use_quota=True,user_id='0ef77b796f3f4149a2a33463510f28cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Creating volume 046073c2-261d-4e32-9c33-8914975968a9 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:00 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-046073c2-261d-4e32-9c33-8914975968a9 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:00 devstack sudo[83416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-046073c2-261d-4e32-9c33-8914975968a9 1073741824 Apr 21 20:52:00 devstack sudo[83416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:00 devstack sudo[83413]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a9d795d4-3a2a-4a24-8d74-541f49de4d5c tempest-VolumesTestJSON-356124756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8b4226e-837b-4c90-8a4d-0e90df1f93f6" returned: 0 in 0.555s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a9d795d4-3a2a-4a24-8d74-541f49de4d5c tempest-VolumesTestJSON-356124756 None] Lock "cinder-quobyte-a8b4226e-837b-4c90-8a4d-0e90df1f93f6" released by "delete_volume" :: held 1.461s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-a9d795d4-3a2a-4a24-8d74-541f49de4d5c tempest-VolumesTestJSON-356124756 None] Created reservations ['26dc36f2-4dd6-4b56-8adc-bc7c009c8395', '7b925458-79cc-4f67-9fa0-7b471d0f5a2c', '024e45bf-b2fa-4340-bcd3-ad3bf92e70b2', '6182649b-75dc-477b-8f8b-b1fb797668b5'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a9d795d4-3a2a-4a24-8d74-541f49de4d5c tempest-VolumesTestJSON-356124756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a9d795d4-3a2a-4a24-8d74-541f49de4d5c tempest-VolumesTestJSON-356124756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a9d795d4-3a2a-4a24-8d74-541f49de4d5c tempest-VolumesTestJSON-356124756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a9d795d4-3a2a-4a24-8d74-541f49de4d5c tempest-VolumesTestJSON-356124756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a9d795d4-3a2a-4a24-8d74-541f49de4d5c tempest-VolumesTestJSON-356124756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a9d795d4-3a2a-4a24-8d74-541f49de4d5c tempest-VolumesTestJSON-356124756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:00 devstack sudo[83419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:52:00 devstack sudo[83419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Flow 'volume_create_manager' (9d67174e-b5ab-4277-8eba-602b85f2af83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f54b9c8-fed6-48af-9d4e-4c4e986629ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f54b9c8-fed6-48af-9d4e-4c4e986629ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-182130377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='933915f5f1354125bb90ab2cc63b8530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:00Z,use_quota=True,user_id='acf6b41283de45a8a54aec6c143ff204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b6f0e5-ddbe-4c6c-b5f6-68089ee31225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b6f0e5-ddbe-4c6c-b5f6-68089ee31225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9853ae6f-4f23-47e3-98ec-4d03f0e1046f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9853ae6f-4f23-47e3-98ec-4d03f0e1046f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b', 'volume_name': 'volume-2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca2af97e-ef41-4e2a-ba7a-36a145e2b278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca2af97e-ef41-4e2a-ba7a-36a145e2b278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496b8b69-24da-49be-aa35-d8c79256216f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:00 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Volume 2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b', 'volume_size': 1} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:00 devstack sudo[83416]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-046073c2-261d-4e32-9c33-8914975968a9 1073741824" returned: 0 in 0.810s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-046073c2-261d-4e32-9c33-8914975968a9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:00 devstack sudo[83428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-046073c2-261d-4e32-9c33-8914975968a9 Apr 21 20:52:00 devstack sudo[83428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ee0bd81a-55d1-4c56-8fef-4ccb31d8875e tempest-VolumesTestJSON-356124756 None] Acquiring lock "cinder-6d63662d-a72b-4d8c-a929-9b61afdbaeb1-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:01 devstack sudo[83419]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a9d795d4-3a2a-4a24-8d74-541f49de4d5c tempest-VolumesTestJSON-356124756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.635s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-a9d795d4-3a2a-4a24-8d74-541f49de4d5c tempest-VolumesTestJSON-356124756 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:01 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-a9d795d4-3a2a-4a24-8d74-541f49de4d5c tempest-VolumesTestJSON-356124756 None] Deleted volume successfully. Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ee0bd81a-55d1-4c56-8fef-4ccb31d8875e tempest-VolumesTestJSON-356124756 None] Lock "cinder-6d63662d-a72b-4d8c-a929-9b61afdbaeb1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a9d795d4-3a2a-4a24-8d74-541f49de4d5c tempest-VolumesTestJSON-356124756 None] Lock "cinder-a8b4226e-837b-4c90-8a4d-0e90df1f93f6-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ee0bd81a-55d1-4c56-8fef-4ccb31d8875e tempest-VolumesTestJSON-356124756 None] Acquiring lock "cinder-quobyte-6d63662d-a72b-4d8c-a929-9b61afdbaeb1" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ee0bd81a-55d1-4c56-8fef-4ccb31d8875e tempest-VolumesTestJSON-356124756 None] Lock "cinder-quobyte-6d63662d-a72b-4d8c-a929-9b61afdbaeb1" acquired by "delete_volume" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13939b8-e954-4119-b080-58e3cd13f2d5]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ee0bd81a-55d1-4c56-8fef-4ccb31d8875e tempest-VolumesTestJSON-356124756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6d63662d-a72b-4d8c-a929-9b61afdbaeb1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:01 devstack sudo[83431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6d63662d-a72b-4d8c-a929-9b61afdbaeb1 Apr 21 20:52:01 devstack sudo[83431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:01 devstack sudo[83428]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-046073c2-261d-4e32-9c33-8914975968a9" returned: 0 in 0.482s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.755s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-182130377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='933915f5f1354125bb90ab2cc63b8530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:00Z,use_quota=True,user_id='acf6b41283de45a8a54aec6c143ff204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Creating volume 2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:01 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941e1e8b-5b80-4d74-9606-48c254fc8dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-046073c2-261d-4e32-9c33-8914975968a9', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f5ee20-ec37-4c65-9bef-98b24ee7648f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:01 devstack sudo[83434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b 1073741824 Apr 21 20:52:01 devstack sudo[83434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:01 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Volume volume-046073c2-261d-4e32-9c33-8914975968a9 (046073c2-261d-4e32-9c33-8914975968a9): created successfully Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f5ee20-ec37-4c65-9bef-98b24ee7648f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Flow 'volume_create_manager' (97b8a8f3-6357-4c08-96e7-38db22828ead) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:01 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-a64a44d8-680b-4fdb-8947-cb9d11ba75fd tempest-VolumesAdminNegativeTest-2122934623 None] Created volume successfully. Apr 21 20:52:01 devstack sudo[83431]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ee0bd81a-55d1-4c56-8fef-4ccb31d8875e tempest-VolumesTestJSON-356124756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6d63662d-a72b-4d8c-a929-9b61afdbaeb1" returned: 0 in 0.540s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ee0bd81a-55d1-4c56-8fef-4ccb31d8875e tempest-VolumesTestJSON-356124756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6d63662d-a72b-4d8c-a929-9b61afdbaeb1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:01 devstack sudo[83439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6d63662d-a72b-4d8c-a929-9b61afdbaeb1 Apr 21 20:52:01 devstack sudo[83439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:01 devstack cinder-volume[81957]: INFO cinder.volume.manager [req-7254d86d-c561-4191-94e9-51367f630ce0 req-1d4c2b83-d43b-4775-8e89-d8c107b289d4 tempest-DeleteServersTestJSON-1337914727 None] Terminate volume connection completed successfully. Apr 21 20:52:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-7254d86d-c561-4191-94e9-51367f630ce0 req-1d4c2b83-d43b-4775-8e89-d8c107b289d4 tempest-DeleteServersTestJSON-1337914727 None] Deleting attachment 2b837c0e-3ad6-4d09-93d2-d9205c345027. {{(pid=81957) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 21 20:52:02 devstack sudo[83434]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b 1073741824" returned: 0 in 0.570s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:02 devstack sudo[83444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b Apr 21 20:52:02 devstack sudo[83444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:02 devstack sudo[83439]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ee0bd81a-55d1-4c56-8fef-4ccb31d8875e tempest-VolumesTestJSON-356124756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6d63662d-a72b-4d8c-a929-9b61afdbaeb1" returned: 0 in 0.533s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ee0bd81a-55d1-4c56-8fef-4ccb31d8875e tempest-VolumesTestJSON-356124756 None] Lock "cinder-quobyte-6d63662d-a72b-4d8c-a929-9b61afdbaeb1" released by "delete_volume" :: held 1.101s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-ee0bd81a-55d1-4c56-8fef-4ccb31d8875e tempest-VolumesTestJSON-356124756 None] Created reservations ['346de0d6-15d2-4ffb-8311-f7c696a8cd91', 'f40448de-266b-4b31-8999-4519f08c5052', '06eabe00-26df-4d47-bba7-cb2769840355', '4835cb33-d366-4927-968d-1e00ca8d7d28'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ee0bd81a-55d1-4c56-8fef-4ccb31d8875e tempest-VolumesTestJSON-356124756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ee0bd81a-55d1-4c56-8fef-4ccb31d8875e tempest-VolumesTestJSON-356124756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ee0bd81a-55d1-4c56-8fef-4ccb31d8875e tempest-VolumesTestJSON-356124756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ee0bd81a-55d1-4c56-8fef-4ccb31d8875e tempest-VolumesTestJSON-356124756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ee0bd81a-55d1-4c56-8fef-4ccb31d8875e tempest-VolumesTestJSON-356124756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ee0bd81a-55d1-4c56-8fef-4ccb31d8875e tempest-VolumesTestJSON-356124756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-65c76027-411d-435a-9539-ceb72f483cf0 tempest-VolumesAdminNegativeTest-2122934623 None] Acquiring lock "cinder-046073c2-261d-4e32-9c33-8914975968a9-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-65c76027-411d-435a-9539-ceb72f483cf0 tempest-VolumesAdminNegativeTest-2122934623 None] Lock "cinder-046073c2-261d-4e32-9c33-8914975968a9-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:02 devstack sudo[83447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:52:02 devstack sudo[83447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-65c76027-411d-435a-9539-ceb72f483cf0 tempest-VolumesAdminNegativeTest-2122934623 None] Acquiring lock "cinder-quobyte-046073c2-261d-4e32-9c33-8914975968a9" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-65c76027-411d-435a-9539-ceb72f483cf0 tempest-VolumesAdminNegativeTest-2122934623 None] Lock "cinder-quobyte-046073c2-261d-4e32-9c33-8914975968a9" acquired by "delete_volume" :: waited 0.020s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf2e527-c8a9-4077-9c7d-a7ec461db672]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-65c76027-411d-435a-9539-ceb72f483cf0 tempest-VolumesAdminNegativeTest-2122934623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-046073c2-261d-4e32-9c33-8914975968a9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:02 devstack sudo[83444]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b" returned: 0 in 0.519s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496b8b69-24da-49be-aa35-d8c79256216f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b100c31-f1a8-40a5-9a34-012119cba6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:02 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Volume volume-2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b (2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b): created successfully Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b100c31-f1a8-40a5-9a34-012119cba6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:02 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Flow 'volume_create_manager' (9d67174e-b5ab-4277-8eba-602b85f2af83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:02 devstack cinder-volume[81957]: INFO cinder.volume.manager [req-b8c68d19-bab3-46d3-a86b-dc4d0bee8785 req-0df1c326-a087-4012-a955-45c1c099ebdd tempest-VolumesGetTestJSON-543082078 None] Created volume successfully. Apr 21 20:52:02 devstack sudo[83450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-046073c2-261d-4e32-9c33-8914975968a9 Apr 21 20:52:02 devstack sudo[83450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:03 devstack sudo[83447]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ee0bd81a-55d1-4c56-8fef-4ccb31d8875e tempest-VolumesTestJSON-356124756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.664s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:03 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-ee0bd81a-55d1-4c56-8fef-4ccb31d8875e tempest-VolumesTestJSON-356124756 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:03 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-ee0bd81a-55d1-4c56-8fef-4ccb31d8875e tempest-VolumesTestJSON-356124756 None] Deleted volume successfully. Apr 21 20:52:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ee0bd81a-55d1-4c56-8fef-4ccb31d8875e tempest-VolumesTestJSON-356124756 None] Lock "cinder-6d63662d-a72b-4d8c-a929-9b61afdbaeb1-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-4ed1a61b-324e-44e0-b199-5ff03a3e59dd req-2b2efef6-8e30-4322-bb0a-be80dff081ab tempest-VolumesGetTestJSON-543082078 None] Acquiring lock "cinder-2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-4ed1a61b-324e-44e0-b199-5ff03a3e59dd req-2b2efef6-8e30-4322-bb0a-be80dff081ab tempest-VolumesGetTestJSON-543082078 None] Lock "cinder-2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-4ed1a61b-324e-44e0-b199-5ff03a3e59dd req-2b2efef6-8e30-4322-bb0a-be80dff081ab tempest-VolumesGetTestJSON-543082078 None] Acquiring lock "cinder-quobyte-2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-4ed1a61b-324e-44e0-b199-5ff03a3e59dd req-2b2efef6-8e30-4322-bb0a-be80dff081ab tempest-VolumesGetTestJSON-543082078 None] Lock "cinder-quobyte-2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:03 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce268dd-c853-4046-b134-7643bd4d7596]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-4ed1a61b-324e-44e0-b199-5ff03a3e59dd req-2b2efef6-8e30-4322-bb0a-be80dff081ab tempest-VolumesGetTestJSON-543082078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:03 devstack sudo[83450]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-65c76027-411d-435a-9539-ceb72f483cf0 tempest-VolumesAdminNegativeTest-2122934623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-046073c2-261d-4e32-9c33-8914975968a9" returned: 0 in 0.680s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-65c76027-411d-435a-9539-ceb72f483cf0 tempest-VolumesAdminNegativeTest-2122934623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-046073c2-261d-4e32-9c33-8914975968a9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:03 devstack sudo[83456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b Apr 21 20:52:03 devstack sudo[83456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:03 devstack sudo[83457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-046073c2-261d-4e32-9c33-8914975968a9 Apr 21 20:52:03 devstack sudo[83457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:03 devstack sudo[83456]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-4ed1a61b-324e-44e0-b199-5ff03a3e59dd req-2b2efef6-8e30-4322-bb0a-be80dff081ab tempest-VolumesGetTestJSON-543082078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b" returned: 0 in 0.595s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-4ed1a61b-324e-44e0-b199-5ff03a3e59dd req-2b2efef6-8e30-4322-bb0a-be80dff081ab tempest-VolumesGetTestJSON-543082078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:03 devstack sudo[83457]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-65c76027-411d-435a-9539-ceb72f483cf0 tempest-VolumesAdminNegativeTest-2122934623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-046073c2-261d-4e32-9c33-8914975968a9" returned: 0 in 0.552s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-65c76027-411d-435a-9539-ceb72f483cf0 tempest-VolumesAdminNegativeTest-2122934623 None] Lock "cinder-quobyte-046073c2-261d-4e32-9c33-8914975968a9" released by "delete_volume" :: held 1.289s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:03 devstack sudo[83464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b Apr 21 20:52:03 devstack sudo[83464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:03 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-65c76027-411d-435a-9539-ceb72f483cf0 tempest-VolumesAdminNegativeTest-2122934623 None] Created reservations ['38a8426b-954f-4be2-8411-da493c6e4e56', '79b88ad1-f1dc-4d3e-95e0-4de6d3470556', '41b3e756-82b8-4b0c-8671-778dc92a7082', '498b845b-b8e8-486b-b73a-2900641b5538'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-65c76027-411d-435a-9539-ceb72f483cf0 tempest-VolumesAdminNegativeTest-2122934623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-65c76027-411d-435a-9539-ceb72f483cf0 tempest-VolumesAdminNegativeTest-2122934623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-65c76027-411d-435a-9539-ceb72f483cf0 tempest-VolumesAdminNegativeTest-2122934623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-65c76027-411d-435a-9539-ceb72f483cf0 tempest-VolumesAdminNegativeTest-2122934623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-65c76027-411d-435a-9539-ceb72f483cf0 tempest-VolumesAdminNegativeTest-2122934623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-65c76027-411d-435a-9539-ceb72f483cf0 tempest-VolumesAdminNegativeTest-2122934623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:03 devstack sudo[83466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:52:03 devstack sudo[83466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:04 devstack sudo[83464]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-4ed1a61b-324e-44e0-b199-5ff03a3e59dd req-2b2efef6-8e30-4322-bb0a-be80dff081ab tempest-VolumesGetTestJSON-543082078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b" returned: 0 in 0.577s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-4ed1a61b-324e-44e0-b199-5ff03a3e59dd req-2b2efef6-8e30-4322-bb0a-be80dff081ab tempest-VolumesGetTestJSON-543082078 None] Lock "cinder-quobyte-2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b" released by "delete_volume" :: held 1.217s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:04 devstack cinder-volume[81957]: DEBUG cinder.quota [req-4ed1a61b-324e-44e0-b199-5ff03a3e59dd req-2b2efef6-8e30-4322-bb0a-be80dff081ab tempest-VolumesGetTestJSON-543082078 None] Created reservations ['abde635f-6649-490f-b624-7c5de02b8a97', 'bb802509-4b7d-4a59-a765-73d5898c3785', '5e1071d6-966e-44b7-8c19-e5275d70c7e8', '600b6a4a-5ec6-4c2e-afd7-3fdd579d04f1'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-4ed1a61b-324e-44e0-b199-5ff03a3e59dd req-2b2efef6-8e30-4322-bb0a-be80dff081ab tempest-VolumesGetTestJSON-543082078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-4ed1a61b-324e-44e0-b199-5ff03a3e59dd req-2b2efef6-8e30-4322-bb0a-be80dff081ab tempest-VolumesGetTestJSON-543082078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-4ed1a61b-324e-44e0-b199-5ff03a3e59dd req-2b2efef6-8e30-4322-bb0a-be80dff081ab tempest-VolumesGetTestJSON-543082078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-4ed1a61b-324e-44e0-b199-5ff03a3e59dd req-2b2efef6-8e30-4322-bb0a-be80dff081ab tempest-VolumesGetTestJSON-543082078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-4ed1a61b-324e-44e0-b199-5ff03a3e59dd req-2b2efef6-8e30-4322-bb0a-be80dff081ab tempest-VolumesGetTestJSON-543082078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-4ed1a61b-324e-44e0-b199-5ff03a3e59dd req-2b2efef6-8e30-4322-bb0a-be80dff081ab tempest-VolumesGetTestJSON-543082078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:04 devstack sudo[83466]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-65c76027-411d-435a-9539-ceb72f483cf0 tempest-VolumesAdminNegativeTest-2122934623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.598s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:04 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-65c76027-411d-435a-9539-ceb72f483cf0 tempest-VolumesAdminNegativeTest-2122934623 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:04 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-65c76027-411d-435a-9539-ceb72f483cf0 tempest-VolumesAdminNegativeTest-2122934623 None] Deleted volume successfully. Apr 21 20:52:04 devstack sudo[83470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:52:04 devstack sudo[83470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-65c76027-411d-435a-9539-ceb72f483cf0 tempest-VolumesAdminNegativeTest-2122934623 None] Lock "cinder-046073c2-261d-4e32-9c33-8914975968a9-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:05 devstack sudo[83470]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-4ed1a61b-324e-44e0-b199-5ff03a3e59dd req-2b2efef6-8e30-4322-bb0a-be80dff081ab tempest-VolumesGetTestJSON-543082078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.581s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:05 devstack cinder-volume[81957]: DEBUG cinder.manager [req-4ed1a61b-324e-44e0-b199-5ff03a3e59dd req-2b2efef6-8e30-4322-bb0a-be80dff081ab tempest-VolumesGetTestJSON-543082078 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:05 devstack cinder-volume[81957]: INFO cinder.volume.manager [req-4ed1a61b-324e-44e0-b199-5ff03a3e59dd req-2b2efef6-8e30-4322-bb0a-be80dff081ab tempest-VolumesGetTestJSON-543082078 None] Deleted volume successfully. Apr 21 20:52:05 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-4ed1a61b-324e-44e0-b199-5ff03a3e59dd req-2b2efef6-8e30-4322-bb0a-be80dff081ab tempest-VolumesGetTestJSON-543082078 None] Lock "cinder-2fd10b93-8a78-4e05-bc7c-e8d71c23bb7b-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:05 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c22e00d8-2901-45d7-9e34-fabc20581c0c tempest-DeleteServersTestJSON-1337914727 None] Acquiring lock "cinder-820668f7-2ad3-4077-bd16-19f5fc7ecc72-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:05 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c22e00d8-2901-45d7-9e34-fabc20581c0c tempest-DeleteServersTestJSON-1337914727 None] Lock "cinder-820668f7-2ad3-4077-bd16-19f5fc7ecc72-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:05 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c22e00d8-2901-45d7-9e34-fabc20581c0c tempest-DeleteServersTestJSON-1337914727 None] Acquiring lock "cinder-quobyte-820668f7-2ad3-4077-bd16-19f5fc7ecc72" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:05 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c22e00d8-2901-45d7-9e34-fabc20581c0c tempest-DeleteServersTestJSON-1337914727 None] Lock "cinder-quobyte-820668f7-2ad3-4077-bd16-19f5fc7ecc72" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:05 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[1847a7c8-f608-449e-8748-1aeaefd050b6]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c22e00d8-2901-45d7-9e34-fabc20581c0c tempest-DeleteServersTestJSON-1337914727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-820668f7-2ad3-4077-bd16-19f5fc7ecc72 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:05 devstack sudo[83475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-820668f7-2ad3-4077-bd16-19f5fc7ecc72 Apr 21 20:52:05 devstack sudo[83475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:06 devstack sudo[83475]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c22e00d8-2901-45d7-9e34-fabc20581c0c tempest-DeleteServersTestJSON-1337914727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-820668f7-2ad3-4077-bd16-19f5fc7ecc72" returned: 0 in 0.712s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c22e00d8-2901-45d7-9e34-fabc20581c0c tempest-DeleteServersTestJSON-1337914727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-820668f7-2ad3-4077-bd16-19f5fc7ecc72 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:06 devstack sudo[83508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-820668f7-2ad3-4077-bd16-19f5fc7ecc72 Apr 21 20:52:06 devstack sudo[83508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:06 devstack sudo[83508]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c22e00d8-2901-45d7-9e34-fabc20581c0c tempest-DeleteServersTestJSON-1337914727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-820668f7-2ad3-4077-bd16-19f5fc7ecc72" returned: 0 in 0.534s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:06 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c22e00d8-2901-45d7-9e34-fabc20581c0c tempest-DeleteServersTestJSON-1337914727 None] Lock "cinder-quobyte-820668f7-2ad3-4077-bd16-19f5fc7ecc72" released by "delete_volume" :: held 1.277s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:06 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-c22e00d8-2901-45d7-9e34-fabc20581c0c tempest-DeleteServersTestJSON-1337914727 None] Created reservations ['f266013a-bc5c-43b6-af88-ff7766c237de', '90b3622f-dd7b-43d5-87da-80af9b363008', '7172e3df-130f-4488-b589-489dd464aaa1', 'ec14c428-0797-47ce-b12b-a76effdad0e1'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c22e00d8-2901-45d7-9e34-fabc20581c0c tempest-DeleteServersTestJSON-1337914727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c22e00d8-2901-45d7-9e34-fabc20581c0c tempest-DeleteServersTestJSON-1337914727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c22e00d8-2901-45d7-9e34-fabc20581c0c tempest-DeleteServersTestJSON-1337914727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c22e00d8-2901-45d7-9e34-fabc20581c0c tempest-DeleteServersTestJSON-1337914727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c22e00d8-2901-45d7-9e34-fabc20581c0c tempest-DeleteServersTestJSON-1337914727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c22e00d8-2901-45d7-9e34-fabc20581c0c tempest-DeleteServersTestJSON-1337914727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:06 devstack sudo[83512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:52:06 devstack sudo[83512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:07 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-469a9a4d-f413-40ce-a2d8-98149cfaf42c tempest-BackendsCapabilitiesAdminTestsJSON-1594192206 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327842712402, 'free_capacity_gb': 1775.7327842712402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81957) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 21 20:52:07 devstack sudo[83512]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c22e00d8-2901-45d7-9e34-fabc20581c0c tempest-DeleteServersTestJSON-1337914727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.445s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:07 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-c22e00d8-2901-45d7-9e34-fabc20581c0c tempest-DeleteServersTestJSON-1337914727 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:07 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-c22e00d8-2901-45d7-9e34-fabc20581c0c tempest-DeleteServersTestJSON-1337914727 None] Deleted volume successfully. Apr 21 20:52:07 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c22e00d8-2901-45d7-9e34-fabc20581c0c tempest-DeleteServersTestJSON-1337914727 None] Lock "cinder-820668f7-2ad3-4077-bd16-19f5fc7ecc72-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:07 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d205dcd5-c352-4d68-aaa8-4943e219a821 tempest-BackendsCapabilitiesAdminTestsJSON-1594192206 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327842712402, 'free_capacity_gb': 1775.7327842712402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81957) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 21 20:52:11 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-5d5c2ff2-c87f-471f-9ceb-e28410c4b172 tempest-GroupsTest-525909094 None] Group tempest-Group1-1202878351: creating Apr 21 20:52:11 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-5d5c2ff2-c87f-471f-9ceb-e28410c4b172 tempest-GroupsTest-525909094 None] Group tempest-Group1-1202878351: created successfully Apr 21 20:52:11 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-5d5c2ff2-c87f-471f-9ceb-e28410c4b172 tempest-GroupsTest-525909094 None] Create group completed successfully. Apr 21 20:52:12 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-6c1c2d6d-8fd9-43a9-8300-2410d11416b2 tempest-GroupSnapshotsV319Test-1952583912 None] Group tempest-GroupSnapshotsV319Test-Group-220466053: creating Apr 21 20:52:12 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-6c1c2d6d-8fd9-43a9-8300-2410d11416b2 tempest-GroupSnapshotsV319Test-1952583912 None] Group tempest-GroupSnapshotsV319Test-Group-220466053: created successfully Apr 21 20:52:12 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-6c1c2d6d-8fd9-43a9-8300-2410d11416b2 tempest-GroupSnapshotsV319Test-1952583912 None] Create group completed successfully. Apr 21 20:52:13 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-45fbd94f-75c8-456b-bb73-e03fc25b67ad tempest-GroupsTest-525909094 None] Group tempest-Group2-1295198729: creating Apr 21 20:52:13 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-45fbd94f-75c8-456b-bb73-e03fc25b67ad tempest-GroupsTest-525909094 None] Group tempest-Group2-1295198729: created successfully Apr 21 20:52:13 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-45fbd94f-75c8-456b-bb73-e03fc25b67ad tempest-GroupsTest-525909094 None] Create group completed successfully. Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Flow 'volume_create_manager' (f92913d8-d2c5-4439-920e-c9d810cd5d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1d62d1-c5c7-4b00-91a7-362ddc20bb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1d62d1-c5c7-4b00-91a7-362ddc20bb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-93890122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2b9693bf-046a-4998-bfdb-3eb8608abf0e,host='devstack@QuobyteHD#QuobyteHD',id=430016a8-a52d-4d5b-983d-9ee6a9b1c810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3afac960de044e7fbd22e1ee3184059c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:14Z,use_quota=True,user_id='29aa277655494099bb0b605b6fdcdc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0108d20-fdac-49f9-9086-8d28f8f96a57),volume_type_id=f0108d20-fdac-49f9-9086-8d28f8f96a57)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540588b9-83cf-43c6-b63f-3b4f2ba29bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540588b9-83cf-43c6-b63f-3b4f2ba29bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39e0d8f-c876-4c23-a746-1eb560219db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39e0d8f-c876-4c23-a746-1eb560219db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '430016a8-a52d-4d5b-983d-9ee6a9b1c810', 'volume_name': 'volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f08ce39-80b4-4a2a-a738-760ef4f952d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f08ce39-80b4-4a2a-a738-760ef4f952d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6667d8c8-dd61-459a-8a6e-4b4fa32a931f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:14 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Volume 430016a8-a52d-4d5b-983d-9ee6a9b1c810: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810', 'volume_size': 1} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2b9693bf-046a-4998-bfdb-3eb8608abf0e,created_at=2026-04-21T18:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-93890122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2b9693bf-046a-4998-bfdb-3eb8608abf0e,host='devstack@QuobyteHD#QuobyteHD',id=430016a8-a52d-4d5b-983d-9ee6a9b1c810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3afac960de044e7fbd22e1ee3184059c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:14Z,use_quota=True,user_id='29aa277655494099bb0b605b6fdcdc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0108d20-fdac-49f9-9086-8d28f8f96a57),volume_type_id=f0108d20-fdac-49f9-9086-8d28f8f96a57)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Creating volume 430016a8-a52d-4d5b-983d-9ee6a9b1c810 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:14 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:14 devstack sudo[83525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810 1073741824 Apr 21 20:52:14 devstack sudo[83525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Flow 'volume_create_manager' (6c6891f8-02ae-446f-892d-a196830bfb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eeade20-8ed8-4f0a-996d-0a6de30965e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eeade20-8ed8-4f0a-996d-0a6de30965e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-881625385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a6aac46d-1bb4-4e43-9dd2-a1370a5f79cd,host='devstack@QuobyteHD#QuobyteHD',id=f3d35990-2d18-4cb1-b670-8c98a7232622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ae9a317696541f7836ee6570352178f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:14Z,use_quota=True,user_id='417fbb0abdaf466199958280e080339c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45933176-b5ba-47d2-9ce2-dd5e99acbf85),volume_type_id=45933176-b5ba-47d2-9ce2-dd5e99acbf85)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7043ef14-bea8-409c-a640-7bcf78893794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7043ef14-bea8-409c-a640-7bcf78893794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c709f9-28f1-4554-a1e4-3bc7b542e763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c709f9-28f1-4554-a1e4-3bc7b542e763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3d35990-2d18-4cb1-b670-8c98a7232622', 'volume_name': 'volume-f3d35990-2d18-4cb1-b670-8c98a7232622', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6deccd03-8ddb-4d08-a5d4-40b9ff5588ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6deccd03-8ddb-4d08-a5d4-40b9ff5588ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de335d20-b85b-4af9-b606-8dee651feaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:14 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Volume f3d35990-2d18-4cb1-b670-8c98a7232622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3d35990-2d18-4cb1-b670-8c98a7232622', 'volume_size': 1} Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:14 devstack sudo[83525]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810 1073741824" returned: 0 in 0.655s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:15 devstack sudo[83530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810 Apr 21 20:52:15 devstack sudo[83530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:15 devstack sudo[83530]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810" returned: 0 in 0.474s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.906s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a6aac46d-1bb4-4e43-9dd2-a1370a5f79cd,created_at=2026-04-21T18:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-881625385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a6aac46d-1bb4-4e43-9dd2-a1370a5f79cd,host='devstack@QuobyteHD#QuobyteHD',id=f3d35990-2d18-4cb1-b670-8c98a7232622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ae9a317696541f7836ee6570352178f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:14Z,use_quota=True,user_id='417fbb0abdaf466199958280e080339c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45933176-b5ba-47d2-9ce2-dd5e99acbf85),volume_type_id=45933176-b5ba-47d2-9ce2-dd5e99acbf85)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:52:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Creating volume f3d35990-2d18-4cb1-b670-8c98a7232622 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:52:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:15 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:52:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f3d35990-2d18-4cb1-b670-8c98a7232622 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6667d8c8-dd61-459a-8a6e-4b4fa32a931f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:15 devstack sudo[83534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f3d35990-2d18-4cb1-b670-8c98a7232622 1073741824 Apr 21 20:52:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99524271-02e3-4711-93e5-507bb9e9f6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:15 devstack sudo[83534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:15 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Volume volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810 (430016a8-a52d-4d5b-983d-9ee6a9b1c810): created successfully Apr 21 20:52:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99524271-02e3-4711-93e5-507bb9e9f6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Flow 'volume_create_manager' (f92913d8-d2c5-4439-920e-c9d810cd5d23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:15 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-7dcf9f7e-862b-4583-abe3-66e252283432 tempest-GroupSnapshotsV319Test-1952583912 None] Created volume successfully. Apr 21 20:52:16 devstack sudo[83534]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f3d35990-2d18-4cb1-b670-8c98a7232622 1073741824" returned: 0 in 0.586s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f3d35990-2d18-4cb1-b670-8c98a7232622 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:16 devstack sudo[83539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f3d35990-2d18-4cb1-b670-8c98a7232622 Apr 21 20:52:16 devstack sudo[83539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:16 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-5bf7668d-5d39-42d9-bef7-814ca81b41de tempest-GroupSnapshotsV319Test-1952583912 None] GroupSnapshot 1700bb84-ad6e-4ae0-849b-f668c0f0de0b: creating. Apr 21 20:52:16 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5bf7668d-5d39-42d9-bef7-814ca81b41de tempest-GroupSnapshotsV319Test-1952583912 None] Group snapshot 1700bb84-ad6e-4ae0-849b-f668c0f0de0b: creating. {{(pid=81957) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 21 20:52:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5bf7668d-5d39-42d9-bef7-814ca81b41de tempest-GroupSnapshotsV319Test-1952583912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:16 devstack sudo[83539]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f3d35990-2d18-4cb1-b670-8c98a7232622" returned: 0 in 0.581s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:16 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5bf7668d-5d39-42d9-bef7-814ca81b41de tempest-GroupSnapshotsV319Test-1952583912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.031s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:16 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de335d20-b85b-4af9-b606-8dee651feaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3d35990-2d18-4cb1-b670-8c98a7232622', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:16 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1023bcb5-7ef0-44cb-98bb-1d15616f350c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:16 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-5bf7668d-5d39-42d9-bef7-814ca81b41de tempest-GroupSnapshotsV319Test-1952583912 None] Creating offline snapshot 1f3e1d41-aae7-4148-bc9f-383b08231ddc of volume 430016a8-a52d-4d5b-983d-9ee6a9b1c810 {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:52:16 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Volume volume-f3d35990-2d18-4cb1-b670-8c98a7232622 (f3d35990-2d18-4cb1-b670-8c98a7232622): created successfully Apr 21 20:52:16 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1023bcb5-7ef0-44cb-98bb-1d15616f350c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:16 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Flow 'volume_create_manager' (6c6891f8-02ae-446f-892d-a196830bfb4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:16 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[43483f97-4b0e-4816-a2e9-902cb676c947]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5bf7668d-5d39-42d9-bef7-814ca81b41de tempest-GroupSnapshotsV319Test-1952583912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:16 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-a1935936-2df7-452c-bb2e-22ae9942ede1 tempest-GroupsTest-525909094 None] Created volume successfully. Apr 21 20:52:16 devstack sudo[83542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810 Apr 21 20:52:16 devstack sudo[83542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:17 devstack sudo[83542]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5bf7668d-5d39-42d9-bef7-814ca81b41de tempest-GroupSnapshotsV319Test-1952583912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810" returned: 0 in 0.461s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5bf7668d-5d39-42d9-bef7-814ca81b41de tempest-GroupSnapshotsV319Test-1952583912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.1f3e1d41-aae7-4148-bc9f-383b08231ddc 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:17 devstack sudo[83548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.1f3e1d41-aae7-4148-bc9f-383b08231ddc 1G Apr 21 20:52:17 devstack sudo[83548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:17 devstack sudo[83548]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5bf7668d-5d39-42d9-bef7-814ca81b41de tempest-GroupSnapshotsV319Test-1952583912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.1f3e1d41-aae7-4148-bc9f-383b08231ddc 1G" returned: 0 in 0.529s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5bf7668d-5d39-42d9-bef7-814ca81b41de tempest-GroupSnapshotsV319Test-1952583912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.1f3e1d41-aae7-4148-bc9f-383b08231ddc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:17 devstack sudo[83553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.1f3e1d41-aae7-4148-bc9f-383b08231ddc Apr 21 20:52:17 devstack sudo[83553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:18 devstack sudo[83553]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5bf7668d-5d39-42d9-bef7-814ca81b41de tempest-GroupSnapshotsV319Test-1952583912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.1f3e1d41-aae7-4148-bc9f-383b08231ddc" returned: 0 in 0.520s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:18 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-5bf7668d-5d39-42d9-bef7-814ca81b41de tempest-GroupSnapshotsV319Test-1952583912 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.1f3e1d41-aae7-4148-bc9f-383b08231ddc is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:52:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5bf7668d-5d39-42d9-bef7-814ca81b41de tempest-GroupSnapshotsV319Test-1952583912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.1f3e1d41-aae7-4148-bc9f-383b08231ddc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:18 devstack sudo[83558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.1f3e1d41-aae7-4148-bc9f-383b08231ddc Apr 21 20:52:18 devstack sudo[83558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:18 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1e41620a-620a-46cf-9325-be054262acc9 tempest-GroupsTest-525909094 None] Acquiring lock "cinder-quobyte-f3d35990-2d18-4cb1-b670-8c98a7232622" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:18 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1e41620a-620a-46cf-9325-be054262acc9 tempest-GroupsTest-525909094 None] Lock "cinder-quobyte-f3d35990-2d18-4cb1-b670-8c98a7232622" acquired by "delete_volume" :: waited 0.020s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:18 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a32661-96bd-485d-a9f0-63eafba3fdcb]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1e41620a-620a-46cf-9325-be054262acc9 tempest-GroupsTest-525909094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f3d35990-2d18-4cb1-b670-8c98a7232622 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:18 devstack sudo[83560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f3d35990-2d18-4cb1-b670-8c98a7232622 Apr 21 20:52:18 devstack sudo[83560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:18 devstack sudo[83558]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5bf7668d-5d39-42d9-bef7-814ca81b41de tempest-GroupSnapshotsV319Test-1952583912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.1f3e1d41-aae7-4148-bc9f-383b08231ddc" returned: 0 in 0.575s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5bf7668d-5d39-42d9-bef7-814ca81b41de tempest-GroupSnapshotsV319Test-1952583912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:18 devstack sudo[83565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.info Apr 21 20:52:18 devstack sudo[83565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:19 devstack sudo[83560]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1e41620a-620a-46cf-9325-be054262acc9 tempest-GroupsTest-525909094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f3d35990-2d18-4cb1-b670-8c98a7232622" returned: 0 in 0.707s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1e41620a-620a-46cf-9325-be054262acc9 tempest-GroupsTest-525909094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f3d35990-2d18-4cb1-b670-8c98a7232622 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:19 devstack sudo[83570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f3d35990-2d18-4cb1-b670-8c98a7232622 Apr 21 20:52:19 devstack sudo[83570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:19 devstack sudo[83565]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5bf7668d-5d39-42d9-bef7-814ca81b41de tempest-GroupSnapshotsV319Test-1952583912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.info" returned: 0 in 0.583s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:19 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-5bf7668d-5d39-42d9-bef7-814ca81b41de tempest-GroupSnapshotsV319Test-1952583912 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:52:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5bf7668d-5d39-42d9-bef7-814ca81b41de tempest-GroupSnapshotsV319Test-1952583912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:19 devstack sudo[83573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.info Apr 21 20:52:19 devstack sudo[83573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:19 devstack sudo[83570]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1e41620a-620a-46cf-9325-be054262acc9 tempest-GroupsTest-525909094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f3d35990-2d18-4cb1-b670-8c98a7232622" returned: 0 in 0.486s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:19 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1e41620a-620a-46cf-9325-be054262acc9 tempest-GroupsTest-525909094 None] Lock "cinder-quobyte-f3d35990-2d18-4cb1-b670-8c98a7232622" released by "delete_volume" :: held 1.232s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:19 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-1e41620a-620a-46cf-9325-be054262acc9 tempest-GroupsTest-525909094 None] Created reservations ['24d72a48-cd69-40db-a405-5a3899cc0e04'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:19 devstack cinder-volume[81957]: WARNING cinder.quota [None req-1e41620a-620a-46cf-9325-be054262acc9 tempest-GroupsTest-525909094 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-709756935 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-709756935, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:52:19 devstack cinder-volume[81957]: WARNING cinder.quota [None req-1e41620a-620a-46cf-9325-be054262acc9 tempest-GroupsTest-525909094 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-709756935 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-709756935, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:52:19 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-1e41620a-620a-46cf-9325-be054262acc9 tempest-GroupsTest-525909094 None] Created reservations ['40a57ab9-917c-443c-af0e-7d56b2d56f5f', 'd6e38e7c-bbcc-4c25-94e1-2911ef6088ce', '40cc3415-d255-4067-91ca-10461bbdfc2d', 'd8f4335d-0494-46d7-9eab-9fc5d7091244'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1e41620a-620a-46cf-9325-be054262acc9 tempest-GroupsTest-525909094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1e41620a-620a-46cf-9325-be054262acc9 tempest-GroupsTest-525909094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-1e41620a-620a-46cf-9325-be054262acc9 tempest-GroupsTest-525909094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-1e41620a-620a-46cf-9325-be054262acc9 tempest-GroupsTest-525909094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1e41620a-620a-46cf-9325-be054262acc9 tempest-GroupsTest-525909094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1e41620a-620a-46cf-9325-be054262acc9 tempest-GroupsTest-525909094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:19 devstack sudo[83576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:52:19 devstack sudo[83576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:20 devstack sudo[83573]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5bf7668d-5d39-42d9-bef7-814ca81b41de tempest-GroupSnapshotsV319Test-1952583912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.info" returned: 0 in 0.684s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5bf7668d-5d39-42d9-bef7-814ca81b41de tempest-GroupSnapshotsV319Test-1952583912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.426s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:20 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-5bf7668d-5d39-42d9-bef7-814ca81b41de tempest-GroupSnapshotsV319Test-1952583912 None] group_snapshot 1700bb84-ad6e-4ae0-849b-f668c0f0de0b: created successfully Apr 21 20:52:20 devstack sudo[83576]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1e41620a-620a-46cf-9325-be054262acc9 tempest-GroupsTest-525909094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.477s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:20 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-1e41620a-620a-46cf-9325-be054262acc9 tempest-GroupsTest-525909094 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:20 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-1e41620a-620a-46cf-9325-be054262acc9 tempest-GroupsTest-525909094 None] Delete group completed successfully. Apr 21 20:52:20 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-92a064b1-4db2-4473-a5ee-c41381ac9b9c tempest-GroupsTest-525909094 None] Created reservations ['8cf909cb-fa42-4c2a-a7f8-6c4fe2c80b3b'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-92a064b1-4db2-4473-a5ee-c41381ac9b9c tempest-GroupsTest-525909094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-92a064b1-4db2-4473-a5ee-c41381ac9b9c tempest-GroupsTest-525909094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-92a064b1-4db2-4473-a5ee-c41381ac9b9c tempest-GroupsTest-525909094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-92a064b1-4db2-4473-a5ee-c41381ac9b9c tempest-GroupsTest-525909094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-92a064b1-4db2-4473-a5ee-c41381ac9b9c tempest-GroupsTest-525909094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-92a064b1-4db2-4473-a5ee-c41381ac9b9c tempest-GroupsTest-525909094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:20 devstack sudo[83580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:52:20 devstack sudo[83580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:21 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-ec42d785-a5c1-46ee-86f1-e8a285912e76 tempest-GroupSnapshotsV319Test-1952583912 None] group_snapshot 1700bb84-ad6e-4ae0-849b-f668c0f0de0b: deleting Apr 21 20:52:21 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ec42d785-a5c1-46ee-86f1-e8a285912e76 tempest-GroupSnapshotsV319Test-1952583912 None] group_snapshot 1700bb84-ad6e-4ae0-849b-f668c0f0de0b: deleting {{(pid=81957) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 21 20:52:21 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ec42d785-a5c1-46ee-86f1-e8a285912e76 tempest-GroupSnapshotsV319Test-1952583912 None] Acquiring lock "cinder-quobyte-430016a8-a52d-4d5b-983d-9ee6a9b1c810" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:21 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ec42d785-a5c1-46ee-86f1-e8a285912e76 tempest-GroupSnapshotsV319Test-1952583912 None] Lock "cinder-quobyte-430016a8-a52d-4d5b-983d-9ee6a9b1c810" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:21 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ec42d785-a5c1-46ee-86f1-e8a285912e76 tempest-GroupSnapshotsV319Test-1952583912 None] Acquiring lock "cinder-quobyte-1f3e1d41-aae7-4148-bc9f-383b08231ddc" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:21 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ec42d785-a5c1-46ee-86f1-e8a285912e76 tempest-GroupSnapshotsV319Test-1952583912 None] Lock "cinder-quobyte-1f3e1d41-aae7-4148-bc9f-383b08231ddc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:21 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-ec42d785-a5c1-46ee-86f1-e8a285912e76 tempest-GroupSnapshotsV319Test-1952583912 None] Deleting offline snapshot 1f3e1d41-aae7-4148-bc9f-383b08231ddc of volume 430016a8-a52d-4d5b-983d-9ee6a9b1c810 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:52:21 devstack sudo[83580]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:21 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-ec42d785-a5c1-46ee-86f1-e8a285912e76 tempest-GroupSnapshotsV319Test-1952583912 None] snapshot_file for this snap is: volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.1f3e1d41-aae7-4148-bc9f-383b08231ddc {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:52:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-92a064b1-4db2-4473-a5ee-c41381ac9b9c tempest-GroupsTest-525909094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.623s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:21 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-92a064b1-4db2-4473-a5ee-c41381ac9b9c tempest-GroupsTest-525909094 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:21 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f986d1b-8307-4526-8d90-a32c1dcaaaef]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ec42d785-a5c1-46ee-86f1-e8a285912e76 tempest-GroupSnapshotsV319Test-1952583912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.1f3e1d41-aae7-4148-bc9f-383b08231ddc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:21 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-92a064b1-4db2-4473-a5ee-c41381ac9b9c tempest-GroupsTest-525909094 None] Delete group completed successfully. Apr 21 20:52:21 devstack sudo[83589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.1f3e1d41-aae7-4148-bc9f-383b08231ddc Apr 21 20:52:21 devstack sudo[83589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:21 devstack sudo[83589]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ec42d785-a5c1-46ee-86f1-e8a285912e76 tempest-GroupSnapshotsV319Test-1952583912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.1f3e1d41-aae7-4148-bc9f-383b08231ddc" returned: 0 in 0.637s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:21 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-ec42d785-a5c1-46ee-86f1-e8a285912e76 tempest-GroupSnapshotsV319Test-1952583912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:52:21 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb64006-f40b-4c29-95bd-83b6355be439]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ec42d785-a5c1-46ee-86f1-e8a285912e76 tempest-GroupSnapshotsV319Test-1952583912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:22 devstack sudo[83597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810 Apr 21 20:52:22 devstack sudo[83597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:22 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-6c6ab416-9713-46ff-97aa-b6e6b1cd9329 tempest-GroupsTest-525909094 None] Group tempest-GroupsTest-Group-2071645572: creating Apr 21 20:52:22 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-6c6ab416-9713-46ff-97aa-b6e6b1cd9329 tempest-GroupsTest-525909094 None] Group tempest-GroupsTest-Group-2071645572: created successfully Apr 21 20:52:22 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-6c6ab416-9713-46ff-97aa-b6e6b1cd9329 tempest-GroupsTest-525909094 None] Create group completed successfully. Apr 21 20:52:22 devstack sudo[83597]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ec42d785-a5c1-46ee-86f1-e8a285912e76 tempest-GroupSnapshotsV319Test-1952583912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810" returned: 0 in 0.629s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ec42d785-a5c1-46ee-86f1-e8a285912e76 tempest-GroupSnapshotsV319Test-1952583912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.1f3e1d41-aae7-4148-bc9f-383b08231ddc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:22 devstack sudo[83602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.1f3e1d41-aae7-4148-bc9f-383b08231ddc Apr 21 20:52:22 devstack sudo[83602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:23 devstack sudo[83602]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ec42d785-a5c1-46ee-86f1-e8a285912e76 tempest-GroupSnapshotsV319Test-1952583912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.1f3e1d41-aae7-4148-bc9f-383b08231ddc" returned: 0 in 0.491s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ec42d785-a5c1-46ee-86f1-e8a285912e76 tempest-GroupSnapshotsV319Test-1952583912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.1f3e1d41-aae7-4148-bc9f-383b08231ddc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:23 devstack sudo[83607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.1f3e1d41-aae7-4148-bc9f-383b08231ddc Apr 21 20:52:23 devstack sudo[83607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:23 devstack sudo[83607]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ec42d785-a5c1-46ee-86f1-e8a285912e76 tempest-GroupSnapshotsV319Test-1952583912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810.1f3e1d41-aae7-4148-bc9f-383b08231ddc" returned: 0 in 0.498s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ec42d785-a5c1-46ee-86f1-e8a285912e76 tempest-GroupSnapshotsV319Test-1952583912 None] Lock "cinder-quobyte-1f3e1d41-aae7-4148-bc9f-383b08231ddc" released by "_delete_snapshot" :: held 2.321s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ec42d785-a5c1-46ee-86f1-e8a285912e76 tempest-GroupSnapshotsV319Test-1952583912 None] Lock "cinder-quobyte-430016a8-a52d-4d5b-983d-9ee6a9b1c810" released by "delete_snapshot" :: held 2.341s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:23 devstack cinder-volume[81957]: WARNING cinder.quota [None req-ec42d785-a5c1-46ee-86f1-e8a285912e76 tempest-GroupSnapshotsV319Test-1952583912 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-484484442 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-484484442, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:52:23 devstack cinder-volume[81957]: WARNING cinder.quota [None req-ec42d785-a5c1-46ee-86f1-e8a285912e76 tempest-GroupSnapshotsV319Test-1952583912 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-484484442 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-484484442, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-ec42d785-a5c1-46ee-86f1-e8a285912e76 tempest-GroupSnapshotsV319Test-1952583912 None] Created reservations ['4744e4dd-8e9a-432b-bc4b-72ee341f51e7', 'd199cc91-324b-41cc-884b-57ad4276eb6d', 'fcf070a0-ad7b-4de0-8449-311e7a08222a', '972bb547-d37c-4aa4-ba12-f5d5e527de50'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:23 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-ec42d785-a5c1-46ee-86f1-e8a285912e76 tempest-GroupSnapshotsV319Test-1952583912 None] group_snapshot 1700bb84-ad6e-4ae0-849b-f668c0f0de0b: deleted successfully Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Flow 'volume_create_manager' (f1c82ea6-76d6-4720-82b8-b6984ee2f103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a947fb-4216-4f3a-96e7-7291dd46f1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a947fb-4216-4f3a-96e7-7291dd46f1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1046581340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95ccd4a2-c50f-41ad-943b-13833132f218,host='devstack@QuobyteHD#QuobyteHD',id=1d85fa34-f34a-4aca-a2cc-5065d441261a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ae9a317696541f7836ee6570352178f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:24Z,use_quota=True,user_id='417fbb0abdaf466199958280e080339c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48296625-8cf0-4ff1-bf8e-7ec1340e8b05),volume_type_id=48296625-8cf0-4ff1-bf8e-7ec1340e8b05)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae4695d-9d63-4751-b2e3-295c554ac628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae4695d-9d63-4751-b2e3-295c554ac628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ca106d-8099-47b9-9252-12cdc2819a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ca106d-8099-47b9-9252-12cdc2819a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d85fa34-f34a-4aca-a2cc-5065d441261a', 'volume_name': 'volume-1d85fa34-f34a-4aca-a2cc-5065d441261a', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9cf36e3-34d5-4561-9898-a4e949b1d8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9cf36e3-34d5-4561-9898-a4e949b1d8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbefe8b5-336c-4fda-a2a5-1f0e186c4207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:23 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Volume 1d85fa34-f34a-4aca-a2cc-5065d441261a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d85fa34-f34a-4aca-a2cc-5065d441261a', 'volume_size': 1} Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=95ccd4a2-c50f-41ad-943b-13833132f218,created_at=2026-04-21T18:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1046581340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95ccd4a2-c50f-41ad-943b-13833132f218,host='devstack@QuobyteHD#QuobyteHD',id=1d85fa34-f34a-4aca-a2cc-5065d441261a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ae9a317696541f7836ee6570352178f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:24Z,use_quota=True,user_id='417fbb0abdaf466199958280e080339c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48296625-8cf0-4ff1-bf8e-7ec1340e8b05),volume_type_id=48296625-8cf0-4ff1-bf8e-7ec1340e8b05)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Creating volume 1d85fa34-f34a-4aca-a2cc-5065d441261a {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:23 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:52:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1d85fa34-f34a-4aca-a2cc-5065d441261a 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:23 devstack sudo[83610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1d85fa34-f34a-4aca-a2cc-5065d441261a 1073741824 Apr 21 20:52:23 devstack sudo[83610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:24 devstack sudo[83610]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1d85fa34-f34a-4aca-a2cc-5065d441261a 1073741824" returned: 0 in 0.605s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1d85fa34-f34a-4aca-a2cc-5065d441261a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:24 devstack sudo[83617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1d85fa34-f34a-4aca-a2cc-5065d441261a Apr 21 20:52:24 devstack sudo[83617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:24 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bf6b729d-2922-4391-b794-d23ed55b5398 tempest-GroupSnapshotsV319Test-1952583912 None] Acquiring lock "cinder-quobyte-430016a8-a52d-4d5b-983d-9ee6a9b1c810" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:24 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bf6b729d-2922-4391-b794-d23ed55b5398 tempest-GroupSnapshotsV319Test-1952583912 None] Lock "cinder-quobyte-430016a8-a52d-4d5b-983d-9ee6a9b1c810" acquired by "delete_volume" :: waited 0.014s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:24 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc87495e-af57-449b-90df-cb2acae5145e]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bf6b729d-2922-4391-b794-d23ed55b5398 tempest-GroupSnapshotsV319Test-1952583912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:24 devstack sudo[83619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810 Apr 21 20:52:24 devstack sudo[83619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:25 devstack sudo[83617]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1d85fa34-f34a-4aca-a2cc-5065d441261a" returned: 0 in 0.597s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:25 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:25 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbefe8b5-336c-4fda-a2a5-1f0e186c4207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d85fa34-f34a-4aca-a2cc-5065d441261a', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:25 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ec0ef8-4575-4632-9a02-b28fb7cc81a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:25 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Volume volume-1d85fa34-f34a-4aca-a2cc-5065d441261a (1d85fa34-f34a-4aca-a2cc-5065d441261a): created successfully Apr 21 20:52:25 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ec0ef8-4575-4632-9a02-b28fb7cc81a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:25 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Flow 'volume_create_manager' (f1c82ea6-76d6-4720-82b8-b6984ee2f103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:25 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-f3e94cdd-ca45-42d8-9c6f-252df24a2d2e tempest-GroupsTest-525909094 None] Created volume successfully. Apr 21 20:52:25 devstack sudo[83619]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bf6b729d-2922-4391-b794-d23ed55b5398 tempest-GroupSnapshotsV319Test-1952583912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810" returned: 0 in 0.685s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bf6b729d-2922-4391-b794-d23ed55b5398 tempest-GroupSnapshotsV319Test-1952583912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:25 devstack sudo[83626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810 Apr 21 20:52:25 devstack sudo[83626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:25 devstack sudo[83626]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bf6b729d-2922-4391-b794-d23ed55b5398 tempest-GroupSnapshotsV319Test-1952583912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-430016a8-a52d-4d5b-983d-9ee6a9b1c810" returned: 0 in 0.539s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bf6b729d-2922-4391-b794-d23ed55b5398 tempest-GroupSnapshotsV319Test-1952583912 None] Lock "cinder-quobyte-430016a8-a52d-4d5b-983d-9ee6a9b1c810" released by "delete_volume" :: held 1.256s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:25 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-bf6b729d-2922-4391-b794-d23ed55b5398 tempest-GroupSnapshotsV319Test-1952583912 None] Created reservations ['c7b08636-d6f0-49b4-977d-627d8adaf265'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:25 devstack cinder-volume[81957]: WARNING cinder.quota [None req-bf6b729d-2922-4391-b794-d23ed55b5398 tempest-GroupSnapshotsV319Test-1952583912 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-484484442 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-484484442, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:52:25 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-bf6b729d-2922-4391-b794-d23ed55b5398 tempest-GroupSnapshotsV319Test-1952583912 None] Created reservations ['c976ee29-50ac-4cfb-b1ce-1cb23fb5d8e2', '771f3504-49a3-49d3-9748-11f2fae80f3c', '0c1ba069-d790-413f-8761-f1642ea52077', 'e13730f0-c256-48c5-9c48-1f9194ce464f'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-bf6b729d-2922-4391-b794-d23ed55b5398 tempest-GroupSnapshotsV319Test-1952583912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-bf6b729d-2922-4391-b794-d23ed55b5398 tempest-GroupSnapshotsV319Test-1952583912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-bf6b729d-2922-4391-b794-d23ed55b5398 tempest-GroupSnapshotsV319Test-1952583912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-bf6b729d-2922-4391-b794-d23ed55b5398 tempest-GroupSnapshotsV319Test-1952583912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-bf6b729d-2922-4391-b794-d23ed55b5398 tempest-GroupSnapshotsV319Test-1952583912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bf6b729d-2922-4391-b794-d23ed55b5398 tempest-GroupSnapshotsV319Test-1952583912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:26 devstack sudo[83629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:52:26 devstack sudo[83629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Flow 'volume_create_manager' (b9bf461d-efd7-485d-a967-b4668978deae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0386fd4e-0a35-4303-b3fd-f8f8d30355ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0386fd4e-0a35-4303-b3fd-f8f8d30355ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2005267711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95ccd4a2-c50f-41ad-943b-13833132f218,host='devstack@QuobyteHD#QuobyteHD',id=0edc9236-7936-4ed4-b77c-5d0a4d06f884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ae9a317696541f7836ee6570352178f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:26Z,use_quota=True,user_id='417fbb0abdaf466199958280e080339c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48296625-8cf0-4ff1-bf8e-7ec1340e8b05),volume_type_id=48296625-8cf0-4ff1-bf8e-7ec1340e8b05)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ce0c4f-eed6-4f89-be6a-3dce634e1195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ce0c4f-eed6-4f89-be6a-3dce634e1195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a389b9f-8c7b-4964-b5f5-5e57f90cc4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a389b9f-8c7b-4964-b5f5-5e57f90cc4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0edc9236-7936-4ed4-b77c-5d0a4d06f884', 'volume_name': 'volume-0edc9236-7936-4ed4-b77c-5d0a4d06f884', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c618e9d-2a0c-4a9e-a852-581a5fe2a490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c618e9d-2a0c-4a9e-a852-581a5fe2a490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc567f77-0d09-42ce-8d59-b0b2e37a977a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:26 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Volume 0edc9236-7936-4ed4-b77c-5d0a4d06f884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0edc9236-7936-4ed4-b77c-5d0a4d06f884', 'volume_size': 1} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=95ccd4a2-c50f-41ad-943b-13833132f218,created_at=2026-04-21T18:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2005267711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95ccd4a2-c50f-41ad-943b-13833132f218,host='devstack@QuobyteHD#QuobyteHD',id=0edc9236-7936-4ed4-b77c-5d0a4d06f884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ae9a317696541f7836ee6570352178f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:26Z,use_quota=True,user_id='417fbb0abdaf466199958280e080339c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48296625-8cf0-4ff1-bf8e-7ec1340e8b05),volume_type_id=48296625-8cf0-4ff1-bf8e-7ec1340e8b05)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Creating volume 0edc9236-7936-4ed4-b77c-5d0a4d06f884 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:26 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0edc9236-7936-4ed4-b77c-5d0a4d06f884 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:26 devstack sudo[83631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0edc9236-7936-4ed4-b77c-5d0a4d06f884 1073741824 Apr 21 20:52:26 devstack sudo[83631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:26 devstack sudo[83629]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bf6b729d-2922-4391-b794-d23ed55b5398 tempest-GroupSnapshotsV319Test-1952583912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.738s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:26 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-bf6b729d-2922-4391-b794-d23ed55b5398 tempest-GroupSnapshotsV319Test-1952583912 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:26 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-bf6b729d-2922-4391-b794-d23ed55b5398 tempest-GroupSnapshotsV319Test-1952583912 None] Delete group completed successfully. Apr 21 20:52:27 devstack sudo[83631]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0edc9236-7936-4ed4-b77c-5d0a4d06f884 1073741824" returned: 0 in 0.738s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0edc9236-7936-4ed4-b77c-5d0a4d06f884 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:27 devstack sudo[83637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0edc9236-7936-4ed4-b77c-5d0a4d06f884 Apr 21 20:52:27 devstack sudo[83637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:27 devstack sudo[83637]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0edc9236-7936-4ed4-b77c-5d0a4d06f884" returned: 0 in 0.632s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:27 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc567f77-0d09-42ce-8d59-b0b2e37a977a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0edc9236-7936-4ed4-b77c-5d0a4d06f884', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f57efc-9d29-49b2-bb64-81a65785399f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:27 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Volume volume-0edc9236-7936-4ed4-b77c-5d0a4d06f884 (0edc9236-7936-4ed4-b77c-5d0a4d06f884): created successfully Apr 21 20:52:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f57efc-9d29-49b2-bb64-81a65785399f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Flow 'volume_create_manager' (b9bf461d-efd7-485d-a967-b4668978deae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:27 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-18e4b04a-7c21-4c39-8f13-e632486aef89 tempest-GroupsTest-525909094 None] Created volume successfully. Apr 21 20:52:28 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-94fa80fc-5159-470c-994d-de4be6d1f156 tempest-GroupsTest-525909094 None] Update group completed successfully. Apr 21 20:52:30 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-da27112a-464f-4991-a300-8050b20762c9 tempest-GroupsTest-525909094 None] Update group completed successfully. Apr 21 20:52:31 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] Acquiring lock "cinder-quobyte-0edc9236-7936-4ed4-b77c-5d0a4d06f884" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:31 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] Lock "cinder-quobyte-0edc9236-7936-4ed4-b77c-5d0a4d06f884" acquired by "delete_volume" :: waited 0.017s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:31 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[a463bce3-e002-449f-ab2b-4f995328b1bc]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0edc9236-7936-4ed4-b77c-5d0a4d06f884 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:31 devstack sudo[83658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0edc9236-7936-4ed4-b77c-5d0a4d06f884 Apr 21 20:52:31 devstack sudo[83658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:32 devstack sudo[83658]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0edc9236-7936-4ed4-b77c-5d0a4d06f884" returned: 0 in 0.741s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0edc9236-7936-4ed4-b77c-5d0a4d06f884 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:32 devstack sudo[83663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0edc9236-7936-4ed4-b77c-5d0a4d06f884 Apr 21 20:52:32 devstack sudo[83663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:32 devstack sudo[83663]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0edc9236-7936-4ed4-b77c-5d0a4d06f884" returned: 0 in 0.737s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] Lock "cinder-quobyte-0edc9236-7936-4ed4-b77c-5d0a4d06f884" released by "delete_volume" :: held 1.525s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] Acquiring lock "cinder-quobyte-1d85fa34-f34a-4aca-a2cc-5065d441261a" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] Lock "cinder-quobyte-1d85fa34-f34a-4aca-a2cc-5065d441261a" acquired by "delete_volume" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[d726977d-7797-41df-b0c8-67a8200351dc]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1d85fa34-f34a-4aca-a2cc-5065d441261a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Flow 'volume_create_manager' (84855edb-bba9-4877-8e07-9ad0f2e77391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:33 devstack sudo[83669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1d85fa34-f34a-4aca-a2cc-5065d441261a Apr 21 20:52:33 devstack sudo[83669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039c5cf7-6406-47de-b43e-96c20a21540a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039c5cf7-6406-47de-b43e-96c20a21540a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1748942555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82fad66a-6cd7-43ff-8376-c63abfff8b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70666b14ec384e90b01007e9b3ee5de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:33Z,use_quota=True,user_id='8209f5779eb440f0bef47859d2ef5c8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c03bf77-b4a6-42f2-a57d-271177b68fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c03bf77-b4a6-42f2-a57d-271177b68fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f840cae7-006e-4070-9dd9-19310262223a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f840cae7-006e-4070-9dd9-19310262223a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82fad66a-6cd7-43ff-8376-c63abfff8b8a', 'volume_name': 'volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01d4609-eb43-4e94-9aa7-69bfef5322c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01d4609-eb43-4e94-9aa7-69bfef5322c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd71578f-5546-4967-9b8c-3f2b32a9fbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:33 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Volume 82fad66a-6cd7-43ff-8376-c63abfff8b8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a', 'volume_size': 1} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1748942555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82fad66a-6cd7-43ff-8376-c63abfff8b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70666b14ec384e90b01007e9b3ee5de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:33Z,use_quota=True,user_id='8209f5779eb440f0bef47859d2ef5c8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Creating volume 82fad66a-6cd7-43ff-8376-c63abfff8b8a {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:33 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:33 devstack sudo[83671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a 1073741824 Apr 21 20:52:33 devstack sudo[83671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:33 devstack sudo[83669]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1d85fa34-f34a-4aca-a2cc-5065d441261a" returned: 0 in 0.664s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1d85fa34-f34a-4aca-a2cc-5065d441261a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:33 devstack sudo[83683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1d85fa34-f34a-4aca-a2cc-5065d441261a Apr 21 20:52:33 devstack sudo[83683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:33 devstack sudo[83671]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a 1073741824" returned: 0 in 0.563s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:33 devstack sudo[83685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a Apr 21 20:52:33 devstack sudo[83685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:34 devstack sudo[83685]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a" returned: 0 in 0.429s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:34 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:34 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:UPDATE=129,cinder:SELECT=133,cinder:INSERT=30,cinder:DELETE=7 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:52:34 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd71578f-5546-4967-9b8c-3f2b32a9fbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:34 devstack sudo[83683]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:34 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c949f5-3a4c-4c52-a1ba-30e54b1bdb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:34 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:SELECT=112,cinder:UPDATE=147,cinder:INSERT=31,cinder:DELETE=12 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:52:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1d85fa34-f34a-4aca-a2cc-5065d441261a" returned: 0 in 0.575s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:34 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Volume volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a (82fad66a-6cd7-43ff-8376-c63abfff8b8a): created successfully Apr 21 20:52:34 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c949f5-3a4c-4c52-a1ba-30e54b1bdb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:34 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Flow 'volume_create_manager' (84855edb-bba9-4877-8e07-9ad0f2e77391) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:34 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] Lock "cinder-quobyte-1d85fa34-f34a-4aca-a2cc-5065d441261a" released by "delete_volume" :: held 1.284s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:34 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-5a8d6e9a-ec42-4806-82ac-13dd51ef371b tempest-SnapshotsActionsTest-950442099 None] Created volume successfully. Apr 21 20:52:34 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] Created reservations ['97990131-64b9-4f63-a4e5-7e047e833e37'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:34 devstack cinder-volume[81957]: WARNING cinder.quota [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-393401864 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-393401864, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:52:34 devstack cinder-volume[81957]: WARNING cinder.quota [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-393401864 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-393401864, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:52:34 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] Created reservations ['7f248a19-e9be-495c-9302-88453992b5a0', 'a4fcfcd7-9251-4ced-b6c4-82d69795ded4', '1289cc67-1480-475d-b871-a75d9c8251b0', '2b3ba878-349b-497a-afb5-1e1fd12caed7'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:34 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] Created reservations ['fceb2195-d5e4-4ae5-9cc8-3cf4881c5c40', '2ea552c5-98e4-4366-8d55-98f6fdf054f7', '3a8a51de-207c-404b-a209-78d4963f66a1', 'f4065c38-1d9b-4883-a49c-f0c41783b976'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:34 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:34 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:34 devstack sudo[83721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:52:34 devstack sudo[83721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:35 devstack sudo[83721]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.584s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:35 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:35 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-c973ce21-51a4-4ae4-85ad-9e7f88a0abbe tempest-GroupsTest-525909094 None] Delete group completed successfully. Apr 21 20:52:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f488d649-be0a-4e87-9bed-4b9f7cb9a9b6 tempest-SnapshotsActionsTest-950442099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f488d649-be0a-4e87-9bed-4b9f7cb9a9b6 tempest-SnapshotsActionsTest-950442099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:35 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-f488d649-be0a-4e87-9bed-4b9f7cb9a9b6 tempest-SnapshotsActionsTest-950442099 None] Creating offline snapshot 29dd86eb-102d-46ce-9386-ddf4fe021c18 of volume 82fad66a-6cd7-43ff-8376-c63abfff8b8a {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:52:35 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[2831e843-de6b-43c4-88d2-1484ad15a21f]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f488d649-be0a-4e87-9bed-4b9f7cb9a9b6 tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:35 devstack sudo[83727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a Apr 21 20:52:35 devstack sudo[83727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:36 devstack sudo[83727]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f488d649-be0a-4e87-9bed-4b9f7cb9a9b6 tempest-SnapshotsActionsTest-950442099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a" returned: 0 in 0.680s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f488d649-be0a-4e87-9bed-4b9f7cb9a9b6 tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:36 devstack sudo[83733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 1G Apr 21 20:52:36 devstack sudo[83733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:36 devstack sudo[83733]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f488d649-be0a-4e87-9bed-4b9f7cb9a9b6 tempest-SnapshotsActionsTest-950442099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 1G" returned: 0 in 0.657s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f488d649-be0a-4e87-9bed-4b9f7cb9a9b6 tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:36 devstack sudo[83744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 Apr 21 20:52:36 devstack sudo[83744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:37 devstack sudo[83744]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f488d649-be0a-4e87-9bed-4b9f7cb9a9b6 tempest-SnapshotsActionsTest-950442099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18" returned: 0 in 0.694s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:37 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-f488d649-be0a-4e87-9bed-4b9f7cb9a9b6 tempest-SnapshotsActionsTest-950442099 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 is being set with open permissions: ugo+rw Apr 21 20:52:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f488d649-be0a-4e87-9bed-4b9f7cb9a9b6 tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:37 devstack sudo[83754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 Apr 21 20:52:37 devstack sudo[83754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:37 devstack sudo[83754]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f488d649-be0a-4e87-9bed-4b9f7cb9a9b6 tempest-SnapshotsActionsTest-950442099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18" returned: 0 in 0.536s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f488d649-be0a-4e87-9bed-4b9f7cb9a9b6 tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:38 devstack sudo[83760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.info Apr 21 20:52:38 devstack sudo[83760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:38 devstack sudo[83760]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f488d649-be0a-4e87-9bed-4b9f7cb9a9b6 tempest-SnapshotsActionsTest-950442099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.info" returned: 0 in 0.767s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:38 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-f488d649-be0a-4e87-9bed-4b9f7cb9a9b6 tempest-SnapshotsActionsTest-950442099 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.info is being set with open permissions: ugo+rw Apr 21 20:52:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f488d649-be0a-4e87-9bed-4b9f7cb9a9b6 tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:38 devstack sudo[83764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.info Apr 21 20:52:38 devstack sudo[83764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:39 devstack sudo[83764]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f488d649-be0a-4e87-9bed-4b9f7cb9a9b6 tempest-SnapshotsActionsTest-950442099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.info" returned: 0 in 0.636s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f488d649-be0a-4e87-9bed-4b9f7cb9a9b6 tempest-SnapshotsActionsTest-950442099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.063s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:39 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-f488d649-be0a-4e87-9bed-4b9f7cb9a9b6 tempest-SnapshotsActionsTest-950442099 None] Create snapshot completed successfully Apr 21 20:52:39 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-4017082d-5ce4-44e8-b418-094cbd960bcb tempest-GroupsV314Test-435701953 None] Group tempest-GroupsV314Test-Group-2072715062: creating Apr 21 20:52:39 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-4017082d-5ce4-44e8-b418-094cbd960bcb tempest-GroupsV314Test-435701953 None] Group tempest-GroupsV314Test-Group-2072715062: created successfully Apr 21 20:52:39 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-4017082d-5ce4-44e8-b418-094cbd960bcb tempest-GroupsV314Test-435701953 None] Create group completed successfully. Apr 21 20:52:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b546f800-a019-4c3f-b4ca-c09b7933a6db tempest-SnapshotsActionsTest-950442099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b546f800-a019-4c3f-b4ca-c09b7933a6db tempest-SnapshotsActionsTest-950442099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:41 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-b546f800-a019-4c3f-b4ca-c09b7933a6db tempest-SnapshotsActionsTest-950442099 None] Creating offline snapshot 35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b of volume 82fad66a-6cd7-43ff-8376-c63abfff8b8a {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:52:41 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b29bd3c-5d60-4652-85ac-de19f71b3099]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b546f800-a019-4c3f-b4ca-c09b7933a6db tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:41 devstack sudo[83784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 Apr 21 20:52:41 devstack sudo[83784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:41 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:41 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Flow 'volume_create_manager' (2674e484-d298-4ff8-a4c2-e3ae9a348b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:41 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd79ec1e-ee33-455a-bb22-62297b3ead63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:41 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd79ec1e-ee33-455a-bb22-62297b3ead63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1873447521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=497d10d1-d65c-47c5-bc95-55b210bd305b,host='devstack@QuobyteHD#QuobyteHD',id=741d4e22-8bcd-4354-83d6-8cb04281eacd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce52057326834afd9c0f162ea1a84b7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:41Z,use_quota=True,user_id='4804d97506be43cea1cf97482984795b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a92a00b-fe27-483f-9e79-bded6befdbe1),volume_type_id=6a92a00b-fe27-483f-9e79-bded6befdbe1)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:41 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2631feb-dd19-4745-8282-85f1347a6b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:41 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2631feb-dd19-4745-8282-85f1347a6b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:41 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402371fa-2841-4101-9477-f7148c6ee863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:41 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402371fa-2841-4101-9477-f7148c6ee863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '741d4e22-8bcd-4354-83d6-8cb04281eacd', 'volume_name': 'volume-741d4e22-8bcd-4354-83d6-8cb04281eacd', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:41 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce465ec-3e8e-450e-a7d2-b63102e03c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:41 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce465ec-3e8e-450e-a7d2-b63102e03c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:41 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb9fce0-9a51-4b25-8eb2-1926cd39a0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:41 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Volume 741d4e22-8bcd-4354-83d6-8cb04281eacd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-741d4e22-8bcd-4354-83d6-8cb04281eacd', 'volume_size': 1} Apr 21 20:52:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:41 devstack sudo[83784]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b546f800-a019-4c3f-b4ca-c09b7933a6db tempest-SnapshotsActionsTest-950442099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18" returned: 0 in 0.531s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:41 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-b546f800-a019-4c3f-b4ca-c09b7933a6db tempest-SnapshotsActionsTest-950442099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:52:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b546f800-a019-4c3f-b4ca-c09b7933a6db tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:41 devstack sudo[83790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b 1G Apr 21 20:52:41 devstack sudo[83790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:42 devstack sudo[83790]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b546f800-a019-4c3f-b4ca-c09b7933a6db tempest-SnapshotsActionsTest-950442099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b 1G" returned: 0 in 0.732s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b546f800-a019-4c3f-b4ca-c09b7933a6db tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:42 devstack sudo[83795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b Apr 21 20:52:42 devstack sudo[83795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:42 devstack sudo[83795]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b546f800-a019-4c3f-b4ca-c09b7933a6db tempest-SnapshotsActionsTest-950442099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b" returned: 0 in 0.530s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:42 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-b546f800-a019-4c3f-b4ca-c09b7933a6db tempest-SnapshotsActionsTest-950442099 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b is being set with open permissions: ugo+rw Apr 21 20:52:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b546f800-a019-4c3f-b4ca-c09b7933a6db tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:42 devstack sudo[83800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b Apr 21 20:52:42 devstack sudo[83800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:43 devstack sudo[83800]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b546f800-a019-4c3f-b4ca-c09b7933a6db tempest-SnapshotsActionsTest-950442099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b" returned: 0 in 0.580s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b546f800-a019-4c3f-b4ca-c09b7933a6db tempest-SnapshotsActionsTest-950442099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.448s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.205s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=497d10d1-d65c-47c5-bc95-55b210bd305b,created_at=2026-04-21T18:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1873447521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=497d10d1-d65c-47c5-bc95-55b210bd305b,host='devstack@QuobyteHD#QuobyteHD',id=741d4e22-8bcd-4354-83d6-8cb04281eacd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce52057326834afd9c0f162ea1a84b7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:41Z,use_quota=True,user_id='4804d97506be43cea1cf97482984795b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a92a00b-fe27-483f-9e79-bded6befdbe1),volume_type_id=6a92a00b-fe27-483f-9e79-bded6befdbe1)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:52:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Creating volume 741d4e22-8bcd-4354-83d6-8cb04281eacd {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:52:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:43 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:52:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:43 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-b546f800-a019-4c3f-b4ca-c09b7933a6db tempest-SnapshotsActionsTest-950442099 None] Create snapshot completed successfully Apr 21 20:52:43 devstack sudo[83809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd 1073741824 Apr 21 20:52:43 devstack sudo[83809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:44 devstack sudo[83809]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd 1073741824" returned: 0 in 0.735s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:44 devstack sudo[83828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd Apr 21 20:52:44 devstack sudo[83828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:44 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5a61110-6376-46b6-91f7-3684e2e85140 tempest-SnapshotsActionsTest-843677735 None] Acquiring lock "cinder-35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:44 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5a61110-6376-46b6-91f7-3684e2e85140 tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:44 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5a61110-6376-46b6-91f7-3684e2e85140 tempest-SnapshotsActionsTest-843677735 None] Acquiring lock "cinder-quobyte-82fad66a-6cd7-43ff-8376-c63abfff8b8a" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:44 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5a61110-6376-46b6-91f7-3684e2e85140 tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-quobyte-82fad66a-6cd7-43ff-8376-c63abfff8b8a" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:44 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5a61110-6376-46b6-91f7-3684e2e85140 tempest-SnapshotsActionsTest-843677735 None] Acquiring lock "cinder-quobyte-35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:44 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5a61110-6376-46b6-91f7-3684e2e85140 tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-quobyte-35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:44 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-c5a61110-6376-46b6-91f7-3684e2e85140 tempest-SnapshotsActionsTest-843677735 None] Deleting offline snapshot 35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b of volume 82fad66a-6cd7-43ff-8376-c63abfff8b8a {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:52:44 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-c5a61110-6376-46b6-91f7-3684e2e85140 tempest-SnapshotsActionsTest-843677735 None] snapshot_file for this snap is: volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:52:44 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[9996fd7c-829b-461a-8b9c-16c5eed2407d]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c5a61110-6376-46b6-91f7-3684e2e85140 tempest-SnapshotsActionsTest-843677735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:44 devstack sudo[83830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b Apr 21 20:52:44 devstack sudo[83830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:44 devstack sudo[83828]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd" returned: 0 in 0.465s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:44 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb9fce0-9a51-4b25-8eb2-1926cd39a0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-741d4e22-8bcd-4354-83d6-8cb04281eacd', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1760fa23-d744-49c7-ba44-f744c97720bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:44 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Volume volume-741d4e22-8bcd-4354-83d6-8cb04281eacd (741d4e22-8bcd-4354-83d6-8cb04281eacd): created successfully Apr 21 20:52:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1760fa23-d744-49c7-ba44-f744c97720bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Flow 'volume_create_manager' (2674e484-d298-4ff8-a4c2-e3ae9a348b25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:44 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-b959b60f-ed78-4273-b32d-e67ef8c256d9 tempest-GroupsV314Test-435701953 None] Created volume successfully. Apr 21 20:52:44 devstack sudo[83830]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c5a61110-6376-46b6-91f7-3684e2e85140 tempest-SnapshotsActionsTest-843677735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b" returned: 0 in 0.535s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:44 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-c5a61110-6376-46b6-91f7-3684e2e85140 tempest-SnapshotsActionsTest-843677735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:52:44 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[4201536a-eae0-48f7-9961-13068a83be46]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c5a61110-6376-46b6-91f7-3684e2e85140 tempest-SnapshotsActionsTest-843677735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:45 devstack sudo[83836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 Apr 21 20:52:45 devstack sudo[83836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:45 devstack sudo[83836]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c5a61110-6376-46b6-91f7-3684e2e85140 tempest-SnapshotsActionsTest-843677735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18" returned: 0 in 1.072s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-c5a61110-6376-46b6-91f7-3684e2e85140 tempest-SnapshotsActionsTest-843677735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:52:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c5a61110-6376-46b6-91f7-3684e2e85140 tempest-SnapshotsActionsTest-843677735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:46 devstack sudo[83871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b Apr 21 20:52:46 devstack sudo[83871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:46 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Cloning volume 741d4e22-8bcd-4354-83d6-8cb04281eacd to volume 0bc347b9-20ff-49fa-b977-5de92deb5a1d Apr 21 20:52:46 devstack sudo[83871]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c5a61110-6376-46b6-91f7-3684e2e85140 tempest-SnapshotsActionsTest-843677735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b" returned: 0 in 0.962s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c5a61110-6376-46b6-91f7-3684e2e85140 tempest-SnapshotsActionsTest-843677735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:46 devstack sudo[83891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b Apr 21 20:52:46 devstack sudo[83891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Creating offline snapshot c1b8ca47-92d5-4847-afe3-793091a4080f of volume 741d4e22-8bcd-4354-83d6-8cb04281eacd {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:52:47 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9951149-0485-4a2f-bc57-000c1e571e87]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:47 devstack sudo[83893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd Apr 21 20:52:47 devstack sudo[83893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:47 devstack sudo[83891]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c5a61110-6376-46b6-91f7-3684e2e85140 tempest-SnapshotsActionsTest-843677735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b" returned: 0 in 0.579s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5a61110-6376-46b6-91f7-3684e2e85140 tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-quobyte-35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b" released by "_delete_snapshot" :: held 3.207s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5a61110-6376-46b6-91f7-3684e2e85140 tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-quobyte-82fad66a-6cd7-43ff-8376-c63abfff8b8a" released by "delete_snapshot" :: held 3.219s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:47 devstack sudo[83893]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd" returned: 0 in 0.602s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.c1b8ca47-92d5-4847-afe3-793091a4080f 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:47 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-c5a61110-6376-46b6-91f7-3684e2e85140 tempest-SnapshotsActionsTest-843677735 None] Created reservations ['8eb6d25e-bf2b-4030-9fac-f401bf0ff162', '3e7b12c2-8ba2-4c81-ae22-6839d426b082', 'c6be0ff5-b82e-4497-9e82-f798a94cbf6e', '12118de4-82e4-4770-a67a-49064fd7f47b'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:47 devstack sudo[83899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.c1b8ca47-92d5-4847-afe3-793091a4080f 1G Apr 21 20:52:47 devstack sudo[83899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:47 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-c5a61110-6376-46b6-91f7-3684e2e85140 tempest-SnapshotsActionsTest-843677735 None] Delete snapshot completed successfully. Apr 21 20:52:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5a61110-6376-46b6-91f7-3684e2e85140 tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-35a0dc40-7f8f-491e-a03c-5b1fdbce0a5b-delete_snapshot" released by "delete_snapshot" :: held 3.371s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:48 devstack sudo[83899]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.c1b8ca47-92d5-4847-afe3-793091a4080f 1G" returned: 0 in 1.216s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-741d4e22-8bcd-4354-83d6-8cb04281eacd -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.c1b8ca47-92d5-4847-afe3-793091a4080f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:48 devstack sudo[83934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-741d4e22-8bcd-4354-83d6-8cb04281eacd -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.c1b8ca47-92d5-4847-afe3-793091a4080f Apr 21 20:52:48 devstack sudo[83934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d9054217-b220-4aea-80c4-c981c0a00975 tempest-SnapshotsActionsTest-950442099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:49 devstack sudo[83934]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-741d4e22-8bcd-4354-83d6-8cb04281eacd -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.c1b8ca47-92d5-4847-afe3-793091a4080f" returned: 0 in 0.900s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:49 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.c1b8ca47-92d5-4847-afe3-793091a4080f is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:52:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.c1b8ca47-92d5-4847-afe3-793091a4080f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:49 devstack sudo[83942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.c1b8ca47-92d5-4847-afe3-793091a4080f Apr 21 20:52:49 devstack sudo[83942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:50 devstack sudo[83942]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.c1b8ca47-92d5-4847-afe3-793091a4080f" returned: 0 in 0.456s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:50 devstack sudo[83946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.info Apr 21 20:52:50 devstack sudo[83946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:50 devstack sudo[83946]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.info" returned: 0 in 0.635s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:50 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:52:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:50 devstack sudo[83950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.info Apr 21 20:52:50 devstack sudo[83950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:51 devstack sudo[83950]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.info" returned: 0 in 0.576s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Acquiring lock "cinder-quobyte-0bc347b9-20ff-49fa-b977-5de92deb5a1d" by "_copy_volume_from_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Lock "cinder-quobyte-0bc347b9-20ff-49fa-b977-5de92deb5a1d" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:51 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] snapshot: c1b8ca47-92d5-4847-afe3-793091a4080f, volume: 0bc347b9-20ff-49fa-b977-5de92deb5a1d, {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:52:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:51 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:51 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:51 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99e99b9-a1fb-4110-bad8-494952f5730b]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.c1b8ca47-92d5-4847-afe3-793091a4080f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:51 devstack sudo[83954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.c1b8ca47-92d5-4847-afe3-793091a4080f Apr 21 20:52:51 devstack sudo[83954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:52 devstack sudo[83954]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.c1b8ca47-92d5-4847-afe3-793091a4080f" returned: 0 in 0.637s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:52 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-741d4e22-8bcd-4354-83d6-8cb04281eacd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:52:52 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:52:52 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Creating direct copy from snapshot {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:52:52 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a01b60-0533-4bcf-a51c-d448521705a6]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:52 devstack sudo[83966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd Apr 21 20:52:52 devstack sudo[83966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:52 devstack sudo[83966]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd" returned: 0 in 0.847s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:52 devstack cinder-volume[81957]: DEBUG cinder.utils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Path /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0bc347b9-20ff-49fa-b977-5de92deb5a1d not found in is_blk_device check {{(pid=81957) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:52:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0bc347b9-20ff-49fa-b977-5de92deb5a1d {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:53 devstack sudo[84011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0bc347b9-20ff-49fa-b977-5de92deb5a1d Apr 21 20:52:53 devstack sudo[84011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:53 devstack cinder-volume[81957]: DEBUG oslo_service.periodic_task [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81957) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:52:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:53 devstack sudo[84043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:52:53 devstack sudo[84043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:55 devstack sudo[84043]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 1.646s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:55 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:57 devstack sudo[84011]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0bc347b9-20ff-49fa-b977-5de92deb5a1d" returned: 0 in 4.208s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:57 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e624cb-b43c-456c-a253-fb9c67007c69]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:57 devstack sudo[84086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd Apr 21 20:52:57 devstack sudo[84086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:57 devstack sudo[84086]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd" returned: 0 in 0.709s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:57 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd, size 1024.00 MB, duration 4.21 sec, destination /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0bc347b9-20ff-49fa-b977-5de92deb5a1d {{(pid=81957) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:52:57 devstack cinder-volume[81957]: INFO cinder.image.image_utils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Converted 1024.00 MB image at 243.26 MB/s Apr 21 20:52:57 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0bc347b9-20ff-49fa-b977-5de92deb5a1d is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:52:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0bc347b9-20ff-49fa-b977-5de92deb5a1d {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:57 devstack sudo[84093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0bc347b9-20ff-49fa-b977-5de92deb5a1d Apr 21 20:52:57 devstack sudo[84093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:58 devstack sudo[84093]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0bc347b9-20ff-49fa-b977-5de92deb5a1d" returned: 0 in 0.598s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Lock "cinder-quobyte-0bc347b9-20ff-49fa-b977-5de92deb5a1d" released by "_copy_volume_from_snapshot" :: held 7.065s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Acquiring lock "cinder-quobyte-c1b8ca47-92d5-4847-afe3-793091a4080f" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Lock "cinder-quobyte-c1b8ca47-92d5-4847-afe3-793091a4080f" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Deleting offline snapshot c1b8ca47-92d5-4847-afe3-793091a4080f of volume 741d4e22-8bcd-4354-83d6-8cb04281eacd {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:52:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] snapshot_file for this snap is: volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.c1b8ca47-92d5-4847-afe3-793091a4080f {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:52:58 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f64ab6-0264-491e-bb82-c5a6e2b14bef]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.c1b8ca47-92d5-4847-afe3-793091a4080f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:58 devstack sudo[84096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.c1b8ca47-92d5-4847-afe3-793091a4080f Apr 21 20:52:58 devstack sudo[84096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:59 devstack sudo[84096]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.c1b8ca47-92d5-4847-afe3-793091a4080f" returned: 0 in 0.912s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-741d4e22-8bcd-4354-83d6-8cb04281eacd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:52:59 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a80d122-4cc9-4e52-9668-ecabea8b3257]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:59 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Flow 'volume_create_manager' (e4acfbdf-fdc2-4756-9c4e-5b78940c5c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589b7ac8-f2d3-4f2a-95b3-70fec4f0df8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:59 devstack sudo[84110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd Apr 21 20:52:59 devstack sudo[84110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589b7ac8-f2d3-4f2a-95b3-70fec4f0df8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1342660563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3323ba8-141e-4f40-9630-3baae41af7fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05edba38692d48c2ad2a1135accc81e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:00Z,use_quota=True,user_id='ff0103a09be24b2da1e9c0e2a463b43b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176e30be-5a0e-49fb-bea6-60e726924a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176e30be-5a0e-49fb-bea6-60e726924a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616b1d1a-8188-43b9-988e-df37fe435535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616b1d1a-8188-43b9-988e-df37fe435535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3323ba8-141e-4f40-9630-3baae41af7fd', 'volume_name': 'volume-b3323ba8-141e-4f40-9630-3baae41af7fd', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459e3674-7474-4446-a401-99d8f3cdf173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459e3674-7474-4446-a401-99d8f3cdf173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898add45-8357-4004-949d-0393bf07179a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:59 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Volume b3323ba8-141e-4f40-9630-3baae41af7fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3323ba8-141e-4f40-9630-3baae41af7fd', 'volume_size': 1} Apr 21 20:52:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:00 devstack sudo[84110]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd" returned: 0 in 0.703s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.c1b8ca47-92d5-4847-afe3-793091a4080f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:00 devstack sudo[84119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.c1b8ca47-92d5-4847-afe3-793091a4080f Apr 21 20:53:00 devstack sudo[84119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:00 devstack sudo[84119]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.c1b8ca47-92d5-4847-afe3-793091a4080f" returned: 0 in 0.541s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.c1b8ca47-92d5-4847-afe3-793091a4080f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:00 devstack sudo[84145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.c1b8ca47-92d5-4847-afe3-793091a4080f Apr 21 20:53:00 devstack sudo[84145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:01 devstack sudo[84145]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd.c1b8ca47-92d5-4847-afe3-793091a4080f" returned: 0 in 0.455s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:01 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Lock "cinder-quobyte-c1b8ca47-92d5-4847-afe3-793091a4080f" released by "_delete_snapshot" :: held 2.733s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.432s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d9054217-b220-4aea-80c4-c981c0a00975 tempest-SnapshotsActionsTest-950442099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.099s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-d9054217-b220-4aea-80c4-c981c0a00975 tempest-SnapshotsActionsTest-950442099 None] Creating offline snapshot 4b572422-6c85-4d92-a8a9-fa6445d449b4 of volume 82fad66a-6cd7-43ff-8376-c63abfff8b8a {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:53:01 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c8271f-3721-4125-8c40-ea28fffdc981]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d9054217-b220-4aea-80c4-c981c0a00975 tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:01 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-a60a51fc-af1c-424a-bab6-ada9d75c7c92 tempest-GroupsV314Test-435701953 None] Create group from source-group-497d10d1-d65c-47c5-bc95-55b210bd305b completed successfully. Apr 21 20:53:01 devstack sudo[84148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 Apr 21 20:53:01 devstack sudo[84148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:01 devstack sudo[84148]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d9054217-b220-4aea-80c4-c981c0a00975 tempest-SnapshotsActionsTest-950442099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18" returned: 0 in 0.516s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-d9054217-b220-4aea-80c4-c981c0a00975 tempest-SnapshotsActionsTest-950442099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d9054217-b220-4aea-80c4-c981c0a00975 tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.4b572422-6c85-4d92-a8a9-fa6445d449b4 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:01 devstack sudo[84153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.4b572422-6c85-4d92-a8a9-fa6445d449b4 1G Apr 21 20:53:01 devstack sudo[84153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:02 devstack sudo[84153]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d9054217-b220-4aea-80c4-c981c0a00975 tempest-SnapshotsActionsTest-950442099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.4b572422-6c85-4d92-a8a9-fa6445d449b4 1G" returned: 0 in 0.561s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d9054217-b220-4aea-80c4-c981c0a00975 tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.4b572422-6c85-4d92-a8a9-fa6445d449b4 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:02 devstack sudo[84158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.4b572422-6c85-4d92-a8a9-fa6445d449b4 Apr 21 20:53:02 devstack sudo[84158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-37714782-94ed-47d0-8853-0beb31b3b813 tempest-GroupsV314Test-435701953 None] Acquiring lock "cinder-quobyte-0bc347b9-20ff-49fa-b977-5de92deb5a1d" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-37714782-94ed-47d0-8853-0beb31b3b813 tempest-GroupsV314Test-435701953 None] Lock "cinder-quobyte-0bc347b9-20ff-49fa-b977-5de92deb5a1d" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:02 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8046411-78c3-4e11-aa72-3500c0d09b0c]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-37714782-94ed-47d0-8853-0beb31b3b813 tempest-GroupsV314Test-435701953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0bc347b9-20ff-49fa-b977-5de92deb5a1d {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:02 devstack sudo[84160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0bc347b9-20ff-49fa-b977-5de92deb5a1d Apr 21 20:53:02 devstack sudo[84160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:02 devstack sudo[84158]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d9054217-b220-4aea-80c4-c981c0a00975 tempest-SnapshotsActionsTest-950442099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.4b572422-6c85-4d92-a8a9-fa6445d449b4" returned: 0 in 0.533s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:02 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-d9054217-b220-4aea-80c4-c981c0a00975 tempest-SnapshotsActionsTest-950442099 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.4b572422-6c85-4d92-a8a9-fa6445d449b4 is being set with open permissions: ugo+rw Apr 21 20:53:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d9054217-b220-4aea-80c4-c981c0a00975 tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.4b572422-6c85-4d92-a8a9-fa6445d449b4 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:03 devstack sudo[84165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.4b572422-6c85-4d92-a8a9-fa6445d449b4 Apr 21 20:53:03 devstack sudo[84165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:03 devstack sudo[84160]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-37714782-94ed-47d0-8853-0beb31b3b813 tempest-GroupsV314Test-435701953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0bc347b9-20ff-49fa-b977-5de92deb5a1d" returned: 0 in 0.603s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-37714782-94ed-47d0-8853-0beb31b3b813 tempest-GroupsV314Test-435701953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0bc347b9-20ff-49fa-b977-5de92deb5a1d {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:03 devstack sudo[84170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0bc347b9-20ff-49fa-b977-5de92deb5a1d Apr 21 20:53:03 devstack sudo[84170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:03 devstack sudo[84165]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d9054217-b220-4aea-80c4-c981c0a00975 tempest-SnapshotsActionsTest-950442099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.4b572422-6c85-4d92-a8a9-fa6445d449b4" returned: 0 in 0.481s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d9054217-b220-4aea-80c4-c981c0a00975 tempest-SnapshotsActionsTest-950442099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.167s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.662s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1342660563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3323ba8-141e-4f40-9630-3baae41af7fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05edba38692d48c2ad2a1135accc81e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:00Z,use_quota=True,user_id='ff0103a09be24b2da1e9c0e2a463b43b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Creating volume b3323ba8-141e-4f40-9630-3baae41af7fd {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:03 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:53:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b3323ba8-141e-4f40-9630-3baae41af7fd 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:03 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-d9054217-b220-4aea-80c4-c981c0a00975 tempest-SnapshotsActionsTest-950442099 None] Create snapshot completed successfully Apr 21 20:53:03 devstack sudo[84173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b3323ba8-141e-4f40-9630-3baae41af7fd 1073741824 Apr 21 20:53:03 devstack sudo[84173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:03 devstack sudo[84170]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-37714782-94ed-47d0-8853-0beb31b3b813 tempest-GroupsV314Test-435701953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0bc347b9-20ff-49fa-b977-5de92deb5a1d" returned: 0 in 0.578s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-37714782-94ed-47d0-8853-0beb31b3b813 tempest-GroupsV314Test-435701953 None] Lock "cinder-quobyte-0bc347b9-20ff-49fa-b977-5de92deb5a1d" released by "delete_volume" :: held 1.201s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:03 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-37714782-94ed-47d0-8853-0beb31b3b813 tempest-GroupsV314Test-435701953 None] Created reservations ['1fc77f76-a999-4905-a3bc-4495636eb85e'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:04 devstack cinder-volume[81957]: WARNING cinder.quota [None req-37714782-94ed-47d0-8853-0beb31b3b813 tempest-GroupsV314Test-435701953 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-813440399 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-813440399, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:53:04 devstack cinder-volume[81957]: WARNING cinder.quota [None req-37714782-94ed-47d0-8853-0beb31b3b813 tempest-GroupsV314Test-435701953 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-813440399 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-813440399, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:53:04 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-37714782-94ed-47d0-8853-0beb31b3b813 tempest-GroupsV314Test-435701953 None] Created reservations ['cdc5ef61-f90e-4baf-a9d1-968ec5a23bb9', '2b6ff834-13a9-4df0-bdff-04dd5750d8b2', 'b0dc0f39-9ff8-49e7-8a78-57e3908b6931', '4c9ac2f5-8a0c-45eb-8ea8-8afda6a1e0b1'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-37714782-94ed-47d0-8853-0beb31b3b813 tempest-GroupsV314Test-435701953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-37714782-94ed-47d0-8853-0beb31b3b813 tempest-GroupsV314Test-435701953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-37714782-94ed-47d0-8853-0beb31b3b813 tempest-GroupsV314Test-435701953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-37714782-94ed-47d0-8853-0beb31b3b813 tempest-GroupsV314Test-435701953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-37714782-94ed-47d0-8853-0beb31b3b813 tempest-GroupsV314Test-435701953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-37714782-94ed-47d0-8853-0beb31b3b813 tempest-GroupsV314Test-435701953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0d75a788-683b-4ae8-a0bd-30cb98eb7135 tempest-SnapshotsActionsTest-843677735 None] Acquiring lock "cinder-4b572422-6c85-4d92-a8a9-fa6445d449b4-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:04 devstack sudo[84179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:53:04 devstack sudo[84179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0d75a788-683b-4ae8-a0bd-30cb98eb7135 tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-4b572422-6c85-4d92-a8a9-fa6445d449b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0d75a788-683b-4ae8-a0bd-30cb98eb7135 tempest-SnapshotsActionsTest-843677735 None] Acquiring lock "cinder-quobyte-82fad66a-6cd7-43ff-8376-c63abfff8b8a" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0d75a788-683b-4ae8-a0bd-30cb98eb7135 tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-quobyte-82fad66a-6cd7-43ff-8376-c63abfff8b8a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0d75a788-683b-4ae8-a0bd-30cb98eb7135 tempest-SnapshotsActionsTest-843677735 None] Acquiring lock "cinder-quobyte-4b572422-6c85-4d92-a8a9-fa6445d449b4" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0d75a788-683b-4ae8-a0bd-30cb98eb7135 tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-quobyte-4b572422-6c85-4d92-a8a9-fa6445d449b4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:04 devstack sudo[84173]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-0d75a788-683b-4ae8-a0bd-30cb98eb7135 tempest-SnapshotsActionsTest-843677735 None] Deleting offline snapshot 4b572422-6c85-4d92-a8a9-fa6445d449b4 of volume 82fad66a-6cd7-43ff-8376-c63abfff8b8a {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:53:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-0d75a788-683b-4ae8-a0bd-30cb98eb7135 tempest-SnapshotsActionsTest-843677735 None] snapshot_file for this snap is: volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.4b572422-6c85-4d92-a8a9-fa6445d449b4 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:53:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b3323ba8-141e-4f40-9630-3baae41af7fd 1073741824" returned: 0 in 0.771s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:04 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c16b4b-372f-4c94-a5be-95009fa50b00]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0d75a788-683b-4ae8-a0bd-30cb98eb7135 tempest-SnapshotsActionsTest-843677735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.4b572422-6c85-4d92-a8a9-fa6445d449b4 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b3323ba8-141e-4f40-9630-3baae41af7fd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:04 devstack sudo[84183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b3323ba8-141e-4f40-9630-3baae41af7fd Apr 21 20:53:04 devstack sudo[84183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:04 devstack sudo[84181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.4b572422-6c85-4d92-a8a9-fa6445d449b4 Apr 21 20:53:04 devstack sudo[84181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:05 devstack sudo[84179]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-37714782-94ed-47d0-8853-0beb31b3b813 tempest-GroupsV314Test-435701953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.839s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:05 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-37714782-94ed-47d0-8853-0beb31b3b813 tempest-GroupsV314Test-435701953 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:05 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-37714782-94ed-47d0-8853-0beb31b3b813 tempest-GroupsV314Test-435701953 None] Delete group completed successfully. Apr 21 20:53:05 devstack sudo[84181]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0d75a788-683b-4ae8-a0bd-30cb98eb7135 tempest-SnapshotsActionsTest-843677735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.4b572422-6c85-4d92-a8a9-fa6445d449b4" returned: 0 in 0.882s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:05 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-0d75a788-683b-4ae8-a0bd-30cb98eb7135 tempest-SnapshotsActionsTest-843677735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:05 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[27db27de-12c7-48a3-a04b-d160be4f17b5]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0d75a788-683b-4ae8-a0bd-30cb98eb7135 tempest-SnapshotsActionsTest-843677735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:05 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-178d2eda-b091-4537-bce8-fbef33abdeee tempest-GroupsV314Test-435701953 None] Acquiring lock "cinder-quobyte-741d4e22-8bcd-4354-83d6-8cb04281eacd" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:05 devstack sudo[84183]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:05 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-178d2eda-b091-4537-bce8-fbef33abdeee tempest-GroupsV314Test-435701953 None] Lock "cinder-quobyte-741d4e22-8bcd-4354-83d6-8cb04281eacd" acquired by "delete_volume" :: waited 0.039s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b3323ba8-141e-4f40-9630-3baae41af7fd" returned: 0 in 1.147s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:05 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.009s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:05 devstack sudo[84190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 Apr 21 20:53:05 devstack sudo[84190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:05 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[653dadbb-8342-468e-b0c1-56313e0281e6]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-178d2eda-b091-4537-bce8-fbef33abdeee tempest-GroupsV314Test-435701953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:05 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898add45-8357-4004-949d-0393bf07179a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3323ba8-141e-4f40-9630-3baae41af7fd', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:05 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1dffc5-993c-4d15-bbd6-1d0dd63d39f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:05 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Volume volume-b3323ba8-141e-4f40-9630-3baae41af7fd (b3323ba8-141e-4f40-9630-3baae41af7fd): created successfully Apr 21 20:53:05 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1dffc5-993c-4d15-bbd6-1d0dd63d39f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:05 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Flow 'volume_create_manager' (e4acfbdf-fdc2-4756-9c4e-5b78940c5c97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:05 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-5416cb18-c2cf-41de-88ec-7e44a419a5b6 tempest-ServersNegativeTestJSON-232553501 None] Created volume successfully. Apr 21 20:53:05 devstack sudo[84193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd Apr 21 20:53:05 devstack sudo[84193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:06 devstack sudo[84190]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0d75a788-683b-4ae8-a0bd-30cb98eb7135 tempest-SnapshotsActionsTest-843677735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18" returned: 0 in 1.261s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-0d75a788-683b-4ae8-a0bd-30cb98eb7135 tempest-SnapshotsActionsTest-843677735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0d75a788-683b-4ae8-a0bd-30cb98eb7135 tempest-SnapshotsActionsTest-843677735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.4b572422-6c85-4d92-a8a9-fa6445d449b4 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:06 devstack sudo[84202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.4b572422-6c85-4d92-a8a9-fa6445d449b4 Apr 21 20:53:06 devstack sudo[84202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:06 devstack sudo[84193]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-178d2eda-b091-4537-bce8-fbef33abdeee tempest-GroupsV314Test-435701953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd" returned: 0 in 1.101s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-178d2eda-b091-4537-bce8-fbef33abdeee tempest-GroupsV314Test-435701953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:06 devstack sudo[84204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd Apr 21 20:53:06 devstack sudo[84204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Flow 'volume_create_manager' (627afef4-6f35-4e7c-be88-cddd5d6b5105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c0bc6b-f80a-467f-a4da-1f9f65d24b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c0bc6b-f80a-467f-a4da-1f9f65d24b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:06Z,deleted=False,deleted_at=None,display_description='',display_name='33fed50c-96b1-422f-9a9a-71fd8d636dba-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd661bb0-02cf-45d9-a348-6642c9d8d228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a255d011c2824b3bae82d33c2538b84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:07Z,use_quota=True,user_id='1e38afaf8abb4513be76f05aba60a3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be375d83-31cf-4f73-bb2e-4bdc028aee26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be375d83-31cf-4f73-bb2e-4bdc028aee26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356b4e6d-5304-4959-875c-72af83d6831a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356b4e6d-5304-4959-875c-72af83d6831a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd661bb0-02cf-45d9-a348-6642c9d8d228', 'volume_name': 'volume-fd661bb0-02cf-45d9-a348-6642c9d8d228', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4fc84c-8fe0-4918-b82c-498da68e9790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4fc84c-8fe0-4918-b82c-498da68e9790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a252bc-b12a-43d1-be01-db65043c504e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:06 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Volume fd661bb0-02cf-45d9-a348-6642c9d8d228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd661bb0-02cf-45d9-a348-6642c9d8d228', 'volume_size': 1} Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:06Z,deleted=False,deleted_at=None,display_description='',display_name='33fed50c-96b1-422f-9a9a-71fd8d636dba-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd661bb0-02cf-45d9-a348-6642c9d8d228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a255d011c2824b3bae82d33c2538b84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:07Z,use_quota=True,user_id='1e38afaf8abb4513be76f05aba60a3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Creating volume fd661bb0-02cf-45d9-a348-6642c9d8d228 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:06 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:53:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fd661bb0-02cf-45d9-a348-6642c9d8d228 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:06 devstack sudo[84206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fd661bb0-02cf-45d9-a348-6642c9d8d228 1073741824 Apr 21 20:53:06 devstack sudo[84206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:07 devstack sudo[84204]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-178d2eda-b091-4537-bce8-fbef33abdeee tempest-GroupsV314Test-435701953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-741d4e22-8bcd-4354-83d6-8cb04281eacd" returned: 0 in 1.157s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:07 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-178d2eda-b091-4537-bce8-fbef33abdeee tempest-GroupsV314Test-435701953 None] Lock "cinder-quobyte-741d4e22-8bcd-4354-83d6-8cb04281eacd" released by "delete_volume" :: held 2.337s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:07 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-178d2eda-b091-4537-bce8-fbef33abdeee tempest-GroupsV314Test-435701953 None] Created reservations ['15c3d366-a46a-4257-ac57-edbd0e35d037'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:07 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-178d2eda-b091-4537-bce8-fbef33abdeee tempest-GroupsV314Test-435701953 None] Created reservations ['c49246f3-d6ed-4d2e-8586-616d0b276704', 'a7159abf-3bb0-43a7-94e2-608722d43a09', 'f48ebf54-da93-41f8-8ecc-2ef3cc509d59', '4317412b-ba8a-40d4-a041-e6ff917acb78'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-178d2eda-b091-4537-bce8-fbef33abdeee tempest-GroupsV314Test-435701953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-178d2eda-b091-4537-bce8-fbef33abdeee tempest-GroupsV314Test-435701953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-178d2eda-b091-4537-bce8-fbef33abdeee tempest-GroupsV314Test-435701953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-178d2eda-b091-4537-bce8-fbef33abdeee tempest-GroupsV314Test-435701953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-178d2eda-b091-4537-bce8-fbef33abdeee tempest-GroupsV314Test-435701953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-178d2eda-b091-4537-bce8-fbef33abdeee tempest-GroupsV314Test-435701953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:08 devstack sudo[84217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:53:08 devstack sudo[84217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:08 devstack sudo[84202]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0d75a788-683b-4ae8-a0bd-30cb98eb7135 tempest-SnapshotsActionsTest-843677735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.4b572422-6c85-4d92-a8a9-fa6445d449b4" returned: 0 in 1.699s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0d75a788-683b-4ae8-a0bd-30cb98eb7135 tempest-SnapshotsActionsTest-843677735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.4b572422-6c85-4d92-a8a9-fa6445d449b4 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:08 devstack sudo[84220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.4b572422-6c85-4d92-a8a9-fa6445d449b4 Apr 21 20:53:08 devstack sudo[84220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Flow 'volume_create_manager' (d1bbea45-1fc9-48e8-a69e-e5ab8079a090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57285388-4b51-4e39-bc46-576de3310fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57285388-4b51-4e39-bc46-576de3310fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1366905608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3094d226-adb9-4dd7-8661-d7a8253970c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05edba38692d48c2ad2a1135accc81e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:08Z,use_quota=True,user_id='ff0103a09be24b2da1e9c0e2a463b43b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8932761-d029-434f-b9de-3c5071661d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8932761-d029-434f-b9de-3c5071661d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d1b4d47-4750-43a7-b8fd-b7f05bbc1581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d1b4d47-4750-43a7-b8fd-b7f05bbc1581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3094d226-adb9-4dd7-8661-d7a8253970c1', 'volume_name': 'volume-3094d226-adb9-4dd7-8661-d7a8253970c1', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618fea66-e8c6-45d2-b6a1-196018cb62ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618fea66-e8c6-45d2-b6a1-196018cb62ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc64ca3-7b34-4688-93ca-b1e521fa56b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:08 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Volume 3094d226-adb9-4dd7-8661-d7a8253970c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3094d226-adb9-4dd7-8661-d7a8253970c1', 'volume_size': 1} Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:08 devstack sudo[84206]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fd661bb0-02cf-45d9-a348-6642c9d8d228 1073741824" returned: 0 in 1.749s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fd661bb0-02cf-45d9-a348-6642c9d8d228 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:08 devstack sudo[84224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fd661bb0-02cf-45d9-a348-6642c9d8d228 Apr 21 20:53:08 devstack sudo[84224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:08 devstack sudo[84217]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-178d2eda-b091-4537-bce8-fbef33abdeee tempest-GroupsV314Test-435701953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.774s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-178d2eda-b091-4537-bce8-fbef33abdeee tempest-GroupsV314Test-435701953 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:08 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-178d2eda-b091-4537-bce8-fbef33abdeee tempest-GroupsV314Test-435701953 None] Delete group completed successfully. Apr 21 20:53:08 devstack sudo[84220]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0d75a788-683b-4ae8-a0bd-30cb98eb7135 tempest-SnapshotsActionsTest-843677735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.4b572422-6c85-4d92-a8a9-fa6445d449b4" returned: 0 in 0.717s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0d75a788-683b-4ae8-a0bd-30cb98eb7135 tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-quobyte-4b572422-6c85-4d92-a8a9-fa6445d449b4" released by "_delete_snapshot" :: held 4.662s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:08 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0d75a788-683b-4ae8-a0bd-30cb98eb7135 tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-quobyte-82fad66a-6cd7-43ff-8376-c63abfff8b8a" released by "delete_snapshot" :: held 4.686s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:09 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-0d75a788-683b-4ae8-a0bd-30cb98eb7135 tempest-SnapshotsActionsTest-843677735 None] Created reservations ['120d373a-25c4-4bf6-a195-a25ddcab2f83', '7e6f92ea-74bf-414b-9b1c-975e23254fab', '132607cc-1b28-4498-a596-2f542d8a1a2c', '3c2300d1-880b-42ab-9332-08a3d15ae665'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:09 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-0d75a788-683b-4ae8-a0bd-30cb98eb7135 tempest-SnapshotsActionsTest-843677735 None] Delete snapshot completed successfully. Apr 21 20:53:09 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0d75a788-683b-4ae8-a0bd-30cb98eb7135 tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-4b572422-6c85-4d92-a8a9-fa6445d449b4-delete_snapshot" released by "delete_snapshot" :: held 4.863s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:09 devstack sudo[84224]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fd661bb0-02cf-45d9-a348-6642c9d8d228" returned: 0 in 0.632s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:09 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] <== create_volume: return (2442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.444s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.956s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:09 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1366905608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3094d226-adb9-4dd7-8661-d7a8253970c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05edba38692d48c2ad2a1135accc81e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:08Z,use_quota=True,user_id='ff0103a09be24b2da1e9c0e2a463b43b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:09 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Creating volume 3094d226-adb9-4dd7-8661-d7a8253970c1 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:09 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:09 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:09 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:09 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:53:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3094d226-adb9-4dd7-8661-d7a8253970c1 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a252bc-b12a-43d1-be01-db65043c504e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd661bb0-02cf-45d9-a348-6642c9d8d228', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a891ba08-e4f1-4e98-abc9-31879c8d0dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:09 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Volume volume-fd661bb0-02cf-45d9-a348-6642c9d8d228 (fd661bb0-02cf-45d9-a348-6642c9d8d228): created successfully Apr 21 20:53:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a891ba08-e4f1-4e98-abc9-31879c8d0dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Flow 'volume_create_manager' (627afef4-6f35-4e7c-be88-cddd5d6b5105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:09 devstack sudo[84228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3094d226-adb9-4dd7-8661-d7a8253970c1 1073741824 Apr 21 20:53:09 devstack sudo[84228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:09 devstack cinder-volume[81957]: INFO cinder.volume.manager [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-e1eeac80-c780-4cf9-99b5-4bf8b4923ff8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Created volume successfully. Apr 21 20:53:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1fcd75e0-08c2-4136-9500-74ca2fcd29a9 tempest-SnapshotsActionsTest-950442099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-464509e3-6d19-462b-a592-d5030fcefc87 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:10 devstack sudo[84228]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3094d226-adb9-4dd7-8661-d7a8253970c1 1073741824" returned: 0 in 1.345s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3094d226-adb9-4dd7-8661-d7a8253970c1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:10 devstack sudo[84250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3094d226-adb9-4dd7-8661-d7a8253970c1 Apr 21 20:53:10 devstack sudo[84250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:11 devstack sudo[84250]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3094d226-adb9-4dd7-8661-d7a8253970c1" returned: 0 in 0.522s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:11 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1fcd75e0-08c2-4136-9500-74ca2fcd29a9 tempest-SnapshotsActionsTest-950442099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.414s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc64ca3-7b34-4688-93ca-b1e521fa56b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3094d226-adb9-4dd7-8661-d7a8253970c1', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01f9193-418d-4f51-a56f-86337788acd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:11 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Volume volume-3094d226-adb9-4dd7-8661-d7a8253970c1 (3094d226-adb9-4dd7-8661-d7a8253970c1): created successfully Apr 21 20:53:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01f9193-418d-4f51-a56f-86337788acd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Flow 'volume_create_manager' (d1bbea45-1fc9-48e8-a69e-e5ab8079a090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:11 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-686f8c53-f922-41e2-838f-9f39b1306d46 tempest-ServersNegativeTestJSON-232553501 None] Created volume successfully. Apr 21 20:53:11 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-1fcd75e0-08c2-4136-9500-74ca2fcd29a9 tempest-SnapshotsActionsTest-950442099 None] Creating offline snapshot c1cadf67-b8d9-4781-8f8f-966c1b5ecacf of volume 82fad66a-6cd7-43ff-8376-c63abfff8b8a {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:53:11 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff24b0c-100e-4533-a1bc-cfeea35f6c7b]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1fcd75e0-08c2-4136-9500-74ca2fcd29a9 tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:11 devstack sudo[84276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 Apr 21 20:53:11 devstack sudo[84276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:12 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-aa3cd085-58e9-4691-9693-4dab423f6ef7 tempest-ServersNegativeTestJSON-232553501 None] Acquiring lock "cinder-3094d226-adb9-4dd7-8661-d7a8253970c1-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:12 devstack sudo[84276]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1fcd75e0-08c2-4136-9500-74ca2fcd29a9 tempest-SnapshotsActionsTest-950442099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18" returned: 0 in 0.669s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:12 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-1fcd75e0-08c2-4136-9500-74ca2fcd29a9 tempest-SnapshotsActionsTest-950442099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1fcd75e0-08c2-4136-9500-74ca2fcd29a9 tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.c1cadf67-b8d9-4781-8f8f-966c1b5ecacf 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:12 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-aa3cd085-58e9-4691-9693-4dab423f6ef7 tempest-ServersNegativeTestJSON-232553501 None] Lock "cinder-3094d226-adb9-4dd7-8661-d7a8253970c1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:12 devstack sudo[84281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.c1cadf67-b8d9-4781-8f8f-966c1b5ecacf 1G Apr 21 20:53:12 devstack sudo[84281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:12 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-aa3cd085-58e9-4691-9693-4dab423f6ef7 tempest-ServersNegativeTestJSON-232553501 None] Acquiring lock "cinder-quobyte-3094d226-adb9-4dd7-8661-d7a8253970c1" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:12 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-aa3cd085-58e9-4691-9693-4dab423f6ef7 tempest-ServersNegativeTestJSON-232553501 None] Lock "cinder-quobyte-3094d226-adb9-4dd7-8661-d7a8253970c1" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:12 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f6baef-56fe-44fd-8ece-c9910418916d]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aa3cd085-58e9-4691-9693-4dab423f6ef7 tempest-ServersNegativeTestJSON-232553501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3094d226-adb9-4dd7-8661-d7a8253970c1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:12 devstack sudo[84283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3094d226-adb9-4dd7-8661-d7a8253970c1 Apr 21 20:53:12 devstack sudo[84283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:12 devstack sudo[84281]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1fcd75e0-08c2-4136-9500-74ca2fcd29a9 tempest-SnapshotsActionsTest-950442099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.c1cadf67-b8d9-4781-8f8f-966c1b5ecacf 1G" returned: 0 in 0.638s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1fcd75e0-08c2-4136-9500-74ca2fcd29a9 tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.c1cadf67-b8d9-4781-8f8f-966c1b5ecacf {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:12 devstack sudo[84288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.c1cadf67-b8d9-4781-8f8f-966c1b5ecacf Apr 21 20:53:12 devstack sudo[84288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:12 devstack sudo[84283]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aa3cd085-58e9-4691-9693-4dab423f6ef7 tempest-ServersNegativeTestJSON-232553501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3094d226-adb9-4dd7-8661-d7a8253970c1" returned: 0 in 0.685s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aa3cd085-58e9-4691-9693-4dab423f6ef7 tempest-ServersNegativeTestJSON-232553501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3094d226-adb9-4dd7-8661-d7a8253970c1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:12 devstack sudo[84293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3094d226-adb9-4dd7-8661-d7a8253970c1 Apr 21 20:53:12 devstack sudo[84293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:13 devstack sudo[84288]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1fcd75e0-08c2-4136-9500-74ca2fcd29a9 tempest-SnapshotsActionsTest-950442099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.c1cadf67-b8d9-4781-8f8f-966c1b5ecacf" returned: 0 in 0.641s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:13 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-1fcd75e0-08c2-4136-9500-74ca2fcd29a9 tempest-SnapshotsActionsTest-950442099 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.c1cadf67-b8d9-4781-8f8f-966c1b5ecacf is being set with open permissions: ugo+rw Apr 21 20:53:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1fcd75e0-08c2-4136-9500-74ca2fcd29a9 tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.c1cadf67-b8d9-4781-8f8f-966c1b5ecacf {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:13 devstack sudo[84299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.c1cadf67-b8d9-4781-8f8f-966c1b5ecacf Apr 21 20:53:13 devstack sudo[84299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:13 devstack sudo[84293]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aa3cd085-58e9-4691-9693-4dab423f6ef7 tempest-ServersNegativeTestJSON-232553501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3094d226-adb9-4dd7-8661-d7a8253970c1" returned: 0 in 0.564s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-aa3cd085-58e9-4691-9693-4dab423f6ef7 tempest-ServersNegativeTestJSON-232553501 None] Lock "cinder-quobyte-3094d226-adb9-4dd7-8661-d7a8253970c1" released by "delete_volume" :: held 1.275s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:13 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-aa3cd085-58e9-4691-9693-4dab423f6ef7 tempest-ServersNegativeTestJSON-232553501 None] Created reservations ['6d353e36-c606-43b2-8460-413dc4148344', '91416b01-9753-4f19-8a51-a0d68c5b8591', 'cf2dfa41-0a9b-4fc1-ba4f-32ffae31aaf7', '734dd3a5-8ca1-408a-80e2-516dbfa20587'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-aa3cd085-58e9-4691-9693-4dab423f6ef7 tempest-ServersNegativeTestJSON-232553501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-aa3cd085-58e9-4691-9693-4dab423f6ef7 tempest-ServersNegativeTestJSON-232553501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:13 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-aa3cd085-58e9-4691-9693-4dab423f6ef7 tempest-ServersNegativeTestJSON-232553501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:13 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-aa3cd085-58e9-4691-9693-4dab423f6ef7 tempest-ServersNegativeTestJSON-232553501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-aa3cd085-58e9-4691-9693-4dab423f6ef7 tempest-ServersNegativeTestJSON-232553501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aa3cd085-58e9-4691-9693-4dab423f6ef7 tempest-ServersNegativeTestJSON-232553501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:13 devstack sudo[84301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:53:13 devstack sudo[84301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:13 devstack sudo[84299]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1fcd75e0-08c2-4136-9500-74ca2fcd29a9 tempest-SnapshotsActionsTest-950442099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.c1cadf67-b8d9-4781-8f8f-966c1b5ecacf" returned: 0 in 0.544s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1fcd75e0-08c2-4136-9500-74ca2fcd29a9 tempest-SnapshotsActionsTest-950442099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.682s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-464509e3-6d19-462b-a592-d5030fcefc87 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.629s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:13 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fdee11-be7d-4f86-98d0-bda21395b375]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-464509e3-6d19-462b-a592-d5030fcefc87 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fd661bb0-02cf-45d9-a348-6642c9d8d228 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:13 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-1fcd75e0-08c2-4136-9500-74ca2fcd29a9 tempest-SnapshotsActionsTest-950442099 None] Create snapshot completed successfully Apr 21 20:53:14 devstack sudo[84301]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aa3cd085-58e9-4691-9693-4dab423f6ef7 tempest-ServersNegativeTestJSON-232553501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.528s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:14 devstack sudo[84304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fd661bb0-02cf-45d9-a348-6642c9d8d228 Apr 21 20:53:14 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-aa3cd085-58e9-4691-9693-4dab423f6ef7 tempest-ServersNegativeTestJSON-232553501 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:14 devstack sudo[84304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:14 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-aa3cd085-58e9-4691-9693-4dab423f6ef7 tempest-ServersNegativeTestJSON-232553501 None] Deleted volume successfully. Apr 21 20:53:14 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-aa3cd085-58e9-4691-9693-4dab423f6ef7 tempest-ServersNegativeTestJSON-232553501 None] Lock "cinder-3094d226-adb9-4dd7-8661-d7a8253970c1-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:14 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5aaaa0f-8d4b-422a-8269-9fee691c8f80 tempest-ServersNegativeTestJSON-232553501 None] Acquiring lock "cinder-b3323ba8-141e-4f40-9630-3baae41af7fd-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:14 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5aaaa0f-8d4b-422a-8269-9fee691c8f80 tempest-ServersNegativeTestJSON-232553501 None] Lock "cinder-b3323ba8-141e-4f40-9630-3baae41af7fd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:14 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5aaaa0f-8d4b-422a-8269-9fee691c8f80 tempest-ServersNegativeTestJSON-232553501 None] Acquiring lock "cinder-quobyte-b3323ba8-141e-4f40-9630-3baae41af7fd" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:14 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5aaaa0f-8d4b-422a-8269-9fee691c8f80 tempest-ServersNegativeTestJSON-232553501 None] Lock "cinder-quobyte-b3323ba8-141e-4f40-9630-3baae41af7fd" acquired by "delete_volume" :: waited 0.027s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:14 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b639fb-e92d-4e0f-8785-075b1c40a58c]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c5aaaa0f-8d4b-422a-8269-9fee691c8f80 tempest-ServersNegativeTestJSON-232553501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b3323ba8-141e-4f40-9630-3baae41af7fd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:14 devstack sudo[84304]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-464509e3-6d19-462b-a592-d5030fcefc87 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fd661bb0-02cf-45d9-a348-6642c9d8d228" returned: 0 in 0.632s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-464509e3-6d19-462b-a592-d5030fcefc87 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.646s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:14 devstack sudo[84310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b3323ba8-141e-4f40-9630-3baae41af7fd Apr 21 20:53:14 devstack sudo[84310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-464509e3-6d19-462b-a592-d5030fcefc87 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7', 'name': 'volume-fd661bb0-02cf-45d9-a348-6642c9d8d228', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8df64cb-c5b5-473d-aff6-9abcf028cf9b', 'enforce_multipath': True} {{(pid=81957) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 21 20:53:14 devstack cinder-volume[81957]: INFO cinder.volume.manager [req-12e70bf9-2c45-4dfb-9e8d-4bf198deab92 req-464509e3-6d19-462b-a592-d5030fcefc87 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] attachment_update completed successfully. Apr 21 20:53:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-191a2081-187e-4e9a-b625-4d0b4faffe8d tempest-SnapshotsActionsTest-843677735 None] Acquiring lock "cinder-c1cadf67-b8d9-4781-8f8f-966c1b5ecacf-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:15 devstack sudo[84310]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c5aaaa0f-8d4b-422a-8269-9fee691c8f80 tempest-ServersNegativeTestJSON-232553501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b3323ba8-141e-4f40-9630-3baae41af7fd" returned: 0 in 0.678s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c5aaaa0f-8d4b-422a-8269-9fee691c8f80 tempest-ServersNegativeTestJSON-232553501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b3323ba8-141e-4f40-9630-3baae41af7fd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-191a2081-187e-4e9a-b625-4d0b4faffe8d tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-c1cadf67-b8d9-4781-8f8f-966c1b5ecacf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-191a2081-187e-4e9a-b625-4d0b4faffe8d tempest-SnapshotsActionsTest-843677735 None] Acquiring lock "cinder-quobyte-82fad66a-6cd7-43ff-8376-c63abfff8b8a" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-191a2081-187e-4e9a-b625-4d0b4faffe8d tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-quobyte-82fad66a-6cd7-43ff-8376-c63abfff8b8a" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:15 devstack sudo[84315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b3323ba8-141e-4f40-9630-3baae41af7fd Apr 21 20:53:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-191a2081-187e-4e9a-b625-4d0b4faffe8d tempest-SnapshotsActionsTest-843677735 None] Acquiring lock "cinder-quobyte-c1cadf67-b8d9-4781-8f8f-966c1b5ecacf" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:15 devstack sudo[84315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-191a2081-187e-4e9a-b625-4d0b4faffe8d tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-quobyte-c1cadf67-b8d9-4781-8f8f-966c1b5ecacf" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-191a2081-187e-4e9a-b625-4d0b4faffe8d tempest-SnapshotsActionsTest-843677735 None] Deleting offline snapshot c1cadf67-b8d9-4781-8f8f-966c1b5ecacf of volume 82fad66a-6cd7-43ff-8376-c63abfff8b8a {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:53:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-191a2081-187e-4e9a-b625-4d0b4faffe8d tempest-SnapshotsActionsTest-843677735 None] snapshot_file for this snap is: volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.c1cadf67-b8d9-4781-8f8f-966c1b5ecacf {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:53:15 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b23f5ca-4bff-4cc3-aaac-a6b8444fe514]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-191a2081-187e-4e9a-b625-4d0b4faffe8d tempest-SnapshotsActionsTest-843677735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.c1cadf67-b8d9-4781-8f8f-966c1b5ecacf {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:15 devstack sudo[84317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.c1cadf67-b8d9-4781-8f8f-966c1b5ecacf Apr 21 20:53:15 devstack sudo[84317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:15 devstack sudo[84315]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c5aaaa0f-8d4b-422a-8269-9fee691c8f80 tempest-ServersNegativeTestJSON-232553501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b3323ba8-141e-4f40-9630-3baae41af7fd" returned: 0 in 0.539s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5aaaa0f-8d4b-422a-8269-9fee691c8f80 tempest-ServersNegativeTestJSON-232553501 None] Lock "cinder-quobyte-b3323ba8-141e-4f40-9630-3baae41af7fd" released by "delete_volume" :: held 1.253s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:15 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-c5aaaa0f-8d4b-422a-8269-9fee691c8f80 tempest-ServersNegativeTestJSON-232553501 None] Created reservations ['e3272328-4d1f-4322-92f4-635f6e3b515b', 'cbac2f4d-82e3-4482-9943-51da26653111', 'f75a146e-9109-4730-bda3-9ac0df63f5b1', '19ef1379-0003-4194-84dd-a93a46623f09'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c5aaaa0f-8d4b-422a-8269-9fee691c8f80 tempest-ServersNegativeTestJSON-232553501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c5aaaa0f-8d4b-422a-8269-9fee691c8f80 tempest-ServersNegativeTestJSON-232553501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c5aaaa0f-8d4b-422a-8269-9fee691c8f80 tempest-ServersNegativeTestJSON-232553501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c5aaaa0f-8d4b-422a-8269-9fee691c8f80 tempest-ServersNegativeTestJSON-232553501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c5aaaa0f-8d4b-422a-8269-9fee691c8f80 tempest-ServersNegativeTestJSON-232553501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c5aaaa0f-8d4b-422a-8269-9fee691c8f80 tempest-ServersNegativeTestJSON-232553501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:15 devstack sudo[84323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:53:15 devstack sudo[84323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:16 devstack sudo[84317]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-191a2081-187e-4e9a-b625-4d0b4faffe8d tempest-SnapshotsActionsTest-843677735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.c1cadf67-b8d9-4781-8f8f-966c1b5ecacf" returned: 0 in 0.778s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:16 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-191a2081-187e-4e9a-b625-4d0b4faffe8d tempest-SnapshotsActionsTest-843677735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:16 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96409a3-3f03-4ae9-bc3d-6c82407ec2a9]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-191a2081-187e-4e9a-b625-4d0b4faffe8d tempest-SnapshotsActionsTest-843677735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:16 devstack sudo[84325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 Apr 21 20:53:16 devstack sudo[84325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:16 devstack sudo[84323]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c5aaaa0f-8d4b-422a-8269-9fee691c8f80 tempest-ServersNegativeTestJSON-232553501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.625s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:16 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-c5aaaa0f-8d4b-422a-8269-9fee691c8f80 tempest-ServersNegativeTestJSON-232553501 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:16 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-c5aaaa0f-8d4b-422a-8269-9fee691c8f80 tempest-ServersNegativeTestJSON-232553501 None] Deleted volume successfully. Apr 21 20:53:16 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5aaaa0f-8d4b-422a-8269-9fee691c8f80 tempest-ServersNegativeTestJSON-232553501 None] Lock "cinder-b3323ba8-141e-4f40-9630-3baae41af7fd-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:16 devstack sudo[84325]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-191a2081-187e-4e9a-b625-4d0b4faffe8d tempest-SnapshotsActionsTest-843677735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18" returned: 0 in 0.689s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:16 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-191a2081-187e-4e9a-b625-4d0b4faffe8d tempest-SnapshotsActionsTest-843677735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-191a2081-187e-4e9a-b625-4d0b4faffe8d tempest-SnapshotsActionsTest-843677735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.c1cadf67-b8d9-4781-8f8f-966c1b5ecacf {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:16 devstack sudo[84358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.c1cadf67-b8d9-4781-8f8f-966c1b5ecacf Apr 21 20:53:16 devstack sudo[84358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:17 devstack sudo[84358]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-191a2081-187e-4e9a-b625-4d0b4faffe8d tempest-SnapshotsActionsTest-843677735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.c1cadf67-b8d9-4781-8f8f-966c1b5ecacf" returned: 0 in 0.925s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-191a2081-187e-4e9a-b625-4d0b4faffe8d tempest-SnapshotsActionsTest-843677735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.c1cadf67-b8d9-4781-8f8f-966c1b5ecacf {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:17 devstack sudo[84404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.c1cadf67-b8d9-4781-8f8f-966c1b5ecacf Apr 21 20:53:17 devstack sudo[84404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:18 devstack sudo[84404]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-191a2081-187e-4e9a-b625-4d0b4faffe8d tempest-SnapshotsActionsTest-843677735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.c1cadf67-b8d9-4781-8f8f-966c1b5ecacf" returned: 0 in 0.491s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:18 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-191a2081-187e-4e9a-b625-4d0b4faffe8d tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-quobyte-c1cadf67-b8d9-4781-8f8f-966c1b5ecacf" released by "_delete_snapshot" :: held 3.028s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:18 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-191a2081-187e-4e9a-b625-4d0b4faffe8d tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-quobyte-82fad66a-6cd7-43ff-8376-c63abfff8b8a" released by "delete_snapshot" :: held 3.049s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:18 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-191a2081-187e-4e9a-b625-4d0b4faffe8d tempest-SnapshotsActionsTest-843677735 None] Created reservations ['bb701d62-ee22-4843-94fa-1b6a325862e4', '0aead383-94f6-4a3c-8962-2118cec53768', '6163d031-e2e5-4c5f-be0d-f4de0dc73062', 'b0dee11d-9723-451e-b612-ab7ca579a0c6'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:18 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-191a2081-187e-4e9a-b625-4d0b4faffe8d tempest-SnapshotsActionsTest-843677735 None] Delete snapshot completed successfully. Apr 21 20:53:18 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-191a2081-187e-4e9a-b625-4d0b4faffe8d tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-c1cadf67-b8d9-4781-8f8f-966c1b5ecacf-delete_snapshot" released by "delete_snapshot" :: held 3.218s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-093014e0-cf15-4ea4-8f57-0d65e5ab125d tempest-SnapshotsActionsTest-950442099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-093014e0-cf15-4ea4-8f57-0d65e5ab125d tempest-SnapshotsActionsTest-950442099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-093014e0-cf15-4ea4-8f57-0d65e5ab125d tempest-SnapshotsActionsTest-950442099 None] Creating offline snapshot 54e7a9aa-abd3-4850-a231-cbb2b1756c80 of volume 82fad66a-6cd7-43ff-8376-c63abfff8b8a {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:53:19 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa836a96-99ce-4f70-8445-58cda58a83ac]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-093014e0-cf15-4ea4-8f57-0d65e5ab125d tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:20 devstack sudo[84784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 Apr 21 20:53:20 devstack sudo[84784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:20 devstack sudo[84784]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-093014e0-cf15-4ea4-8f57-0d65e5ab125d tempest-SnapshotsActionsTest-950442099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18" returned: 0 in 0.758s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-093014e0-cf15-4ea4-8f57-0d65e5ab125d tempest-SnapshotsActionsTest-950442099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-093014e0-cf15-4ea4-8f57-0d65e5ab125d tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.54e7a9aa-abd3-4850-a231-cbb2b1756c80 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:20 devstack sudo[84794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.54e7a9aa-abd3-4850-a231-cbb2b1756c80 1G Apr 21 20:53:20 devstack sudo[84794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:21 devstack sudo[84794]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-093014e0-cf15-4ea4-8f57-0d65e5ab125d tempest-SnapshotsActionsTest-950442099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.54e7a9aa-abd3-4850-a231-cbb2b1756c80 1G" returned: 0 in 0.672s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-093014e0-cf15-4ea4-8f57-0d65e5ab125d tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.54e7a9aa-abd3-4850-a231-cbb2b1756c80 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:21 devstack sudo[84799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.54e7a9aa-abd3-4850-a231-cbb2b1756c80 Apr 21 20:53:21 devstack sudo[84799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:21 devstack sudo[84799]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-093014e0-cf15-4ea4-8f57-0d65e5ab125d tempest-SnapshotsActionsTest-950442099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.54e7a9aa-abd3-4850-a231-cbb2b1756c80" returned: 0 in 0.483s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:21 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-093014e0-cf15-4ea4-8f57-0d65e5ab125d tempest-SnapshotsActionsTest-950442099 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.54e7a9aa-abd3-4850-a231-cbb2b1756c80 is being set with open permissions: ugo+rw Apr 21 20:53:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-093014e0-cf15-4ea4-8f57-0d65e5ab125d tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.54e7a9aa-abd3-4850-a231-cbb2b1756c80 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:21 devstack sudo[84804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.54e7a9aa-abd3-4850-a231-cbb2b1756c80 Apr 21 20:53:21 devstack sudo[84804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:22 devstack sudo[84804]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-093014e0-cf15-4ea4-8f57-0d65e5ab125d tempest-SnapshotsActionsTest-950442099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.54e7a9aa-abd3-4850-a231-cbb2b1756c80" returned: 0 in 0.421s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-093014e0-cf15-4ea4-8f57-0d65e5ab125d tempest-SnapshotsActionsTest-950442099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.429s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:22 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-093014e0-cf15-4ea4-8f57-0d65e5ab125d tempest-SnapshotsActionsTest-950442099 None] Create snapshot completed successfully Apr 21 20:53:23 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3a2e39fb-c1f3-4d3d-8872-e1b4de5f7b8c tempest-SnapshotsActionsTest-843677735 None] Acquiring lock "cinder-54e7a9aa-abd3-4850-a231-cbb2b1756c80-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:23 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3a2e39fb-c1f3-4d3d-8872-e1b4de5f7b8c tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-54e7a9aa-abd3-4850-a231-cbb2b1756c80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:23 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3a2e39fb-c1f3-4d3d-8872-e1b4de5f7b8c tempest-SnapshotsActionsTest-843677735 None] Acquiring lock "cinder-quobyte-82fad66a-6cd7-43ff-8376-c63abfff8b8a" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:23 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3a2e39fb-c1f3-4d3d-8872-e1b4de5f7b8c tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-quobyte-82fad66a-6cd7-43ff-8376-c63abfff8b8a" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:23 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3a2e39fb-c1f3-4d3d-8872-e1b4de5f7b8c tempest-SnapshotsActionsTest-843677735 None] Acquiring lock "cinder-quobyte-54e7a9aa-abd3-4850-a231-cbb2b1756c80" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:23 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3a2e39fb-c1f3-4d3d-8872-e1b4de5f7b8c tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-quobyte-54e7a9aa-abd3-4850-a231-cbb2b1756c80" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:23 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-3a2e39fb-c1f3-4d3d-8872-e1b4de5f7b8c tempest-SnapshotsActionsTest-843677735 None] Deleting offline snapshot 54e7a9aa-abd3-4850-a231-cbb2b1756c80 of volume 82fad66a-6cd7-43ff-8376-c63abfff8b8a {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:53:23 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-3a2e39fb-c1f3-4d3d-8872-e1b4de5f7b8c tempest-SnapshotsActionsTest-843677735 None] snapshot_file for this snap is: volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.54e7a9aa-abd3-4850-a231-cbb2b1756c80 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:53:23 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6983b2e-3ddb-415a-83a8-adb5f89ffa47]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3a2e39fb-c1f3-4d3d-8872-e1b4de5f7b8c tempest-SnapshotsActionsTest-843677735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.54e7a9aa-abd3-4850-a231-cbb2b1756c80 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:23 devstack sudo[84808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.54e7a9aa-abd3-4850-a231-cbb2b1756c80 Apr 21 20:53:23 devstack sudo[84808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:23 devstack sudo[84808]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3a2e39fb-c1f3-4d3d-8872-e1b4de5f7b8c tempest-SnapshotsActionsTest-843677735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.54e7a9aa-abd3-4850-a231-cbb2b1756c80" returned: 0 in 0.614s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:23 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-3a2e39fb-c1f3-4d3d-8872-e1b4de5f7b8c tempest-SnapshotsActionsTest-843677735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:23 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c1cbcc-bcd7-4a96-a583-fc19668a4cd2]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3a2e39fb-c1f3-4d3d-8872-e1b4de5f7b8c tempest-SnapshotsActionsTest-843677735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:23 devstack sudo[84814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 Apr 21 20:53:23 devstack sudo[84814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:24 devstack sudo[84814]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3a2e39fb-c1f3-4d3d-8872-e1b4de5f7b8c tempest-SnapshotsActionsTest-843677735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18" returned: 0 in 0.547s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:24 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-3a2e39fb-c1f3-4d3d-8872-e1b4de5f7b8c tempest-SnapshotsActionsTest-843677735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3a2e39fb-c1f3-4d3d-8872-e1b4de5f7b8c tempest-SnapshotsActionsTest-843677735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.54e7a9aa-abd3-4850-a231-cbb2b1756c80 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:24 devstack sudo[84821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.54e7a9aa-abd3-4850-a231-cbb2b1756c80 Apr 21 20:53:24 devstack sudo[84821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:24 devstack sudo[84821]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3a2e39fb-c1f3-4d3d-8872-e1b4de5f7b8c tempest-SnapshotsActionsTest-843677735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.54e7a9aa-abd3-4850-a231-cbb2b1756c80" returned: 0 in 0.625s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3a2e39fb-c1f3-4d3d-8872-e1b4de5f7b8c tempest-SnapshotsActionsTest-843677735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.54e7a9aa-abd3-4850-a231-cbb2b1756c80 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:24 devstack sudo[84826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.54e7a9aa-abd3-4850-a231-cbb2b1756c80 Apr 21 20:53:24 devstack sudo[84826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:25 devstack sudo[84826]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3a2e39fb-c1f3-4d3d-8872-e1b4de5f7b8c tempest-SnapshotsActionsTest-843677735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.54e7a9aa-abd3-4850-a231-cbb2b1756c80" returned: 0 in 0.531s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3a2e39fb-c1f3-4d3d-8872-e1b4de5f7b8c tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-quobyte-54e7a9aa-abd3-4850-a231-cbb2b1756c80" released by "_delete_snapshot" :: held 2.388s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3a2e39fb-c1f3-4d3d-8872-e1b4de5f7b8c tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-quobyte-82fad66a-6cd7-43ff-8376-c63abfff8b8a" released by "delete_snapshot" :: held 2.409s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:25 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-3a2e39fb-c1f3-4d3d-8872-e1b4de5f7b8c tempest-SnapshotsActionsTest-843677735 None] Created reservations ['b33e7dbd-31f5-440e-8f2d-792e69450b28', 'e83bb84d-f17f-463b-9cf1-2f47f0d891b2', '0fc2d910-8079-4002-a0d8-7ac67e6ae229', '3886b5a1-c220-489f-a9a1-5502bcb5ea55'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:25 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-3a2e39fb-c1f3-4d3d-8872-e1b4de5f7b8c tempest-SnapshotsActionsTest-843677735 None] Delete snapshot completed successfully. Apr 21 20:53:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3a2e39fb-c1f3-4d3d-8872-e1b4de5f7b8c tempest-SnapshotsActionsTest-843677735 None] Lock "cinder-54e7a9aa-abd3-4850-a231-cbb2b1756c80-delete_snapshot" released by "delete_snapshot" :: held 2.531s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:26 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1a25eed1-e3d7-45e0-bf63-0ed446bc4aa8 tempest-SnapshotsActionsTest-950442099 None] Acquiring lock "cinder-29dd86eb-102d-46ce-9386-ddf4fe021c18-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:26 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1a25eed1-e3d7-45e0-bf63-0ed446bc4aa8 tempest-SnapshotsActionsTest-950442099 None] Lock "cinder-29dd86eb-102d-46ce-9386-ddf4fe021c18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:26 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1a25eed1-e3d7-45e0-bf63-0ed446bc4aa8 tempest-SnapshotsActionsTest-950442099 None] Acquiring lock "cinder-quobyte-82fad66a-6cd7-43ff-8376-c63abfff8b8a" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:26 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1a25eed1-e3d7-45e0-bf63-0ed446bc4aa8 tempest-SnapshotsActionsTest-950442099 None] Lock "cinder-quobyte-82fad66a-6cd7-43ff-8376-c63abfff8b8a" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:26 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1a25eed1-e3d7-45e0-bf63-0ed446bc4aa8 tempest-SnapshotsActionsTest-950442099 None] Acquiring lock "cinder-quobyte-29dd86eb-102d-46ce-9386-ddf4fe021c18" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:26 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1a25eed1-e3d7-45e0-bf63-0ed446bc4aa8 tempest-SnapshotsActionsTest-950442099 None] Lock "cinder-quobyte-29dd86eb-102d-46ce-9386-ddf4fe021c18" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:26 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-1a25eed1-e3d7-45e0-bf63-0ed446bc4aa8 tempest-SnapshotsActionsTest-950442099 None] Deleting offline snapshot 29dd86eb-102d-46ce-9386-ddf4fe021c18 of volume 82fad66a-6cd7-43ff-8376-c63abfff8b8a {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:53:26 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-1a25eed1-e3d7-45e0-bf63-0ed446bc4aa8 tempest-SnapshotsActionsTest-950442099 None] snapshot_file for this snap is: volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:53:26 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d42d7fd-c121-4347-a5f7-0310c68052fc]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1a25eed1-e3d7-45e0-bf63-0ed446bc4aa8 tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:26 devstack sudo[84830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 Apr 21 20:53:26 devstack sudo[84830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:27 devstack sudo[84830]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1a25eed1-e3d7-45e0-bf63-0ed446bc4aa8 tempest-SnapshotsActionsTest-950442099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18" returned: 0 in 0.603s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-1a25eed1-e3d7-45e0-bf63-0ed446bc4aa8 tempest-SnapshotsActionsTest-950442099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb79525a-b463-42bb-b1e7-7936bdd31477]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1a25eed1-e3d7-45e0-bf63-0ed446bc4aa8 tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Flow 'volume_create_manager' (0f259cae-d082-4747-a860-df05f0efacc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c76bd01-1885-4fdc-beac-d714d64e4ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c76bd01-1885-4fdc-beac-d714d64e4ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-406440656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2e34ef7-9a4e-4f61-a85d-0253f969e207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716ca00ed20a492ab5c7b51345343494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:27Z,use_quota=True,user_id='671294e5668b4f819a42455c8a983466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e032bd9-0517-44ea-aa8b-914a17c3d217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e032bd9-0517-44ea-aa8b-914a17c3d217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:27 devstack sudo[84835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a Apr 21 20:53:27 devstack sudo[84835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676e17fb-75ed-44e3-9cb0-7b120e150c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676e17fb-75ed-44e3-9cb0-7b120e150c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2e34ef7-9a4e-4f61-a85d-0253f969e207', 'volume_name': 'volume-d2e34ef7-9a4e-4f61-a85d-0253f969e207', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b35395-297d-4425-bf0c-3500aa3a4289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b35395-297d-4425-bf0c-3500aa3a4289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a14635-544b-44d9-84ba-b7cdd692365a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:27 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Volume d2e34ef7-9a4e-4f61-a85d-0253f969e207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2e34ef7-9a4e-4f61-a85d-0253f969e207', 'volume_size': 1} Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-406440656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2e34ef7-9a4e-4f61-a85d-0253f969e207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716ca00ed20a492ab5c7b51345343494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:27Z,use_quota=True,user_id='671294e5668b4f819a42455c8a983466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Creating volume d2e34ef7-9a4e-4f61-a85d-0253f969e207 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:27 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:53:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2e34ef7-9a4e-4f61-a85d-0253f969e207 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:27 devstack sudo[84837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2e34ef7-9a4e-4f61-a85d-0253f969e207 1073741824 Apr 21 20:53:27 devstack sudo[84837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:28 devstack sudo[84835]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1a25eed1-e3d7-45e0-bf63-0ed446bc4aa8 tempest-SnapshotsActionsTest-950442099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a" returned: 0 in 0.867s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1a25eed1-e3d7-45e0-bf63-0ed446bc4aa8 tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:28 devstack sudo[84869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 Apr 21 20:53:28 devstack sudo[84869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:28 devstack sudo[84837]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2e34ef7-9a4e-4f61-a85d-0253f969e207 1073741824" returned: 0 in 0.967s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2e34ef7-9a4e-4f61-a85d-0253f969e207 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:28 devstack sudo[84872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2e34ef7-9a4e-4f61-a85d-0253f969e207 Apr 21 20:53:28 devstack sudo[84872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:28 devstack sudo[84872]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2e34ef7-9a4e-4f61-a85d-0253f969e207" returned: 0 in 0.420s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:28 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a14635-544b-44d9-84ba-b7cdd692365a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2e34ef7-9a4e-4f61-a85d-0253f969e207', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (924d6f63-a97e-41af-b63a-3c78fb65a615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:28 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Volume volume-d2e34ef7-9a4e-4f61-a85d-0253f969e207 (d2e34ef7-9a4e-4f61-a85d-0253f969e207): created successfully Apr 21 20:53:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (924d6f63-a97e-41af-b63a-3c78fb65a615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Flow 'volume_create_manager' (0f259cae-d082-4747-a860-df05f0efacc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:28 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-366080fc-3ecc-451c-81ab-ffeb9de2e3c2 tempest-VolumeQuotasAdminTestJSON-562775396 None] Created volume successfully. Apr 21 20:53:28 devstack sudo[84869]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1a25eed1-e3d7-45e0-bf63-0ed446bc4aa8 tempest-SnapshotsActionsTest-950442099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18" returned: 0 in 0.776s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1a25eed1-e3d7-45e0-bf63-0ed446bc4aa8 tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:28 devstack sudo[84879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18 Apr 21 20:53:28 devstack sudo[84879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:29 devstack sudo[84879]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1a25eed1-e3d7-45e0-bf63-0ed446bc4aa8 tempest-SnapshotsActionsTest-950442099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a.29dd86eb-102d-46ce-9386-ddf4fe021c18" returned: 0 in 0.542s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:29 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1a25eed1-e3d7-45e0-bf63-0ed446bc4aa8 tempest-SnapshotsActionsTest-950442099 None] Lock "cinder-quobyte-29dd86eb-102d-46ce-9386-ddf4fe021c18" released by "_delete_snapshot" :: held 2.867s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:29 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1a25eed1-e3d7-45e0-bf63-0ed446bc4aa8 tempest-SnapshotsActionsTest-950442099 None] Lock "cinder-quobyte-82fad66a-6cd7-43ff-8376-c63abfff8b8a" released by "delete_snapshot" :: held 2.882s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:29 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3da7c772-0ebb-4dd5-b3de-a7f83264d241 tempest-VolumeQuotasAdminTestJSON-562775396 None] Acquiring lock "cinder-d2e34ef7-9a4e-4f61-a85d-0253f969e207-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:29 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-1a25eed1-e3d7-45e0-bf63-0ed446bc4aa8 tempest-SnapshotsActionsTest-950442099 None] Created reservations ['268b73ee-67db-4bbd-bf28-e4c564d04afd', '22230434-e99c-48cc-80e9-f45837e6a1a2', '47ffd339-a65e-4390-95a7-eb94093887e6', 'df818521-911b-428f-be3d-5cde166a7c70'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:29 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3da7c772-0ebb-4dd5-b3de-a7f83264d241 tempest-VolumeQuotasAdminTestJSON-562775396 None] Lock "cinder-d2e34ef7-9a4e-4f61-a85d-0253f969e207-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:29 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3da7c772-0ebb-4dd5-b3de-a7f83264d241 tempest-VolumeQuotasAdminTestJSON-562775396 None] Acquiring lock "cinder-quobyte-d2e34ef7-9a4e-4f61-a85d-0253f969e207" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:29 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3da7c772-0ebb-4dd5-b3de-a7f83264d241 tempest-VolumeQuotasAdminTestJSON-562775396 None] Lock "cinder-quobyte-d2e34ef7-9a4e-4f61-a85d-0253f969e207" acquired by "delete_volume" :: waited 0.014s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:29 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[711241ff-ebae-4b99-8d19-417db63b5f62]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3da7c772-0ebb-4dd5-b3de-a7f83264d241 tempest-VolumeQuotasAdminTestJSON-562775396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2e34ef7-9a4e-4f61-a85d-0253f969e207 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:29 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-1a25eed1-e3d7-45e0-bf63-0ed446bc4aa8 tempest-SnapshotsActionsTest-950442099 None] Delete snapshot completed successfully. Apr 21 20:53:29 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1a25eed1-e3d7-45e0-bf63-0ed446bc4aa8 tempest-SnapshotsActionsTest-950442099 None] Lock "cinder-29dd86eb-102d-46ce-9386-ddf4fe021c18-delete_snapshot" released by "delete_snapshot" :: held 3.075s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:29 devstack sudo[84896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2e34ef7-9a4e-4f61-a85d-0253f969e207 Apr 21 20:53:29 devstack sudo[84896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:29 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a3f9acf6-a69c-4dd2-847b-ab9b425b06fa tempest-SnapshotsActionsTest-950442099 None] Acquiring lock "cinder-82fad66a-6cd7-43ff-8376-c63abfff8b8a-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:29 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a3f9acf6-a69c-4dd2-847b-ab9b425b06fa tempest-SnapshotsActionsTest-950442099 None] Lock "cinder-82fad66a-6cd7-43ff-8376-c63abfff8b8a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:29 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a3f9acf6-a69c-4dd2-847b-ab9b425b06fa tempest-SnapshotsActionsTest-950442099 None] Acquiring lock "cinder-quobyte-82fad66a-6cd7-43ff-8376-c63abfff8b8a" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:29 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a3f9acf6-a69c-4dd2-847b-ab9b425b06fa tempest-SnapshotsActionsTest-950442099 None] Lock "cinder-quobyte-82fad66a-6cd7-43ff-8376-c63abfff8b8a" acquired by "delete_volume" :: waited 0.013s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:29 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[994acf49-9c78-4345-9364-aaaabe9b9674]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a3f9acf6-a69c-4dd2-847b-ab9b425b06fa tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:30 devstack sudo[84903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a Apr 21 20:53:30 devstack sudo[84903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:30 devstack sudo[84896]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3da7c772-0ebb-4dd5-b3de-a7f83264d241 tempest-VolumeQuotasAdminTestJSON-562775396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2e34ef7-9a4e-4f61-a85d-0253f969e207" returned: 0 in 0.589s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3da7c772-0ebb-4dd5-b3de-a7f83264d241 tempest-VolumeQuotasAdminTestJSON-562775396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2e34ef7-9a4e-4f61-a85d-0253f969e207 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:30 devstack sudo[84909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2e34ef7-9a4e-4f61-a85d-0253f969e207 Apr 21 20:53:30 devstack sudo[84909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:30 devstack sudo[84903]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a3f9acf6-a69c-4dd2-847b-ab9b425b06fa tempest-SnapshotsActionsTest-950442099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a" returned: 0 in 0.531s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a3f9acf6-a69c-4dd2-847b-ab9b425b06fa tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:30 devstack sudo[84914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a Apr 21 20:53:30 devstack sudo[84914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:30 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-82dd5bea-daf7-42a4-84a4-74a4e05b75e2 tempest-GroupsV320Test-1888584765 None] Group tempest-GroupsV320Test-Group-615899640: creating Apr 21 20:53:30 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-82dd5bea-daf7-42a4-84a4-74a4e05b75e2 tempest-GroupsV320Test-1888584765 None] Group tempest-GroupsV320Test-Group-615899640: created successfully Apr 21 20:53:30 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-82dd5bea-daf7-42a4-84a4-74a4e05b75e2 tempest-GroupsV320Test-1888584765 None] Create group completed successfully. Apr 21 20:53:30 devstack sudo[84909]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3da7c772-0ebb-4dd5-b3de-a7f83264d241 tempest-VolumeQuotasAdminTestJSON-562775396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2e34ef7-9a4e-4f61-a85d-0253f969e207" returned: 0 in 0.483s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:30 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3da7c772-0ebb-4dd5-b3de-a7f83264d241 tempest-VolumeQuotasAdminTestJSON-562775396 None] Lock "cinder-quobyte-d2e34ef7-9a4e-4f61-a85d-0253f969e207" released by "delete_volume" :: held 1.096s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:30 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-3da7c772-0ebb-4dd5-b3de-a7f83264d241 tempest-VolumeQuotasAdminTestJSON-562775396 None] Created reservations ['0d011d8f-e459-4fbd-8c20-f870cfd58003', 'a1c01971-66f1-414d-b11c-567690da3554', 'e38cbe63-1a6d-4aed-9f2a-977a6f2879ba', '53f28ceb-3459-459c-8a16-51c545b8dee5'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3da7c772-0ebb-4dd5-b3de-a7f83264d241 tempest-VolumeQuotasAdminTestJSON-562775396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3da7c772-0ebb-4dd5-b3de-a7f83264d241 tempest-VolumeQuotasAdminTestJSON-562775396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3da7c772-0ebb-4dd5-b3de-a7f83264d241 tempest-VolumeQuotasAdminTestJSON-562775396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3da7c772-0ebb-4dd5-b3de-a7f83264d241 tempest-VolumeQuotasAdminTestJSON-562775396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3da7c772-0ebb-4dd5-b3de-a7f83264d241 tempest-VolumeQuotasAdminTestJSON-562775396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3da7c772-0ebb-4dd5-b3de-a7f83264d241 tempest-VolumeQuotasAdminTestJSON-562775396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:30 devstack sudo[84917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:53:30 devstack sudo[84917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:30 devstack sudo[84914]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a3f9acf6-a69c-4dd2-847b-ab9b425b06fa tempest-SnapshotsActionsTest-950442099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82fad66a-6cd7-43ff-8376-c63abfff8b8a" returned: 0 in 0.423s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:30 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a3f9acf6-a69c-4dd2-847b-ab9b425b06fa tempest-SnapshotsActionsTest-950442099 None] Lock "cinder-quobyte-82fad66a-6cd7-43ff-8376-c63abfff8b8a" released by "delete_volume" :: held 0.984s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:30 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-a3f9acf6-a69c-4dd2-847b-ab9b425b06fa tempest-SnapshotsActionsTest-950442099 None] Created reservations ['22d9f162-46dc-45f7-a9c4-cf4126d0889e', '12321955-c9d3-461e-9b06-4c8dde0e2500', 'cdcdb845-1b72-4d68-982c-a908f0136796', 'ba3d78de-764d-4c33-a605-5716d9b3d112'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a3f9acf6-a69c-4dd2-847b-ab9b425b06fa tempest-SnapshotsActionsTest-950442099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a3f9acf6-a69c-4dd2-847b-ab9b425b06fa tempest-SnapshotsActionsTest-950442099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:31 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a3f9acf6-a69c-4dd2-847b-ab9b425b06fa tempest-SnapshotsActionsTest-950442099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:31 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a3f9acf6-a69c-4dd2-847b-ab9b425b06fa tempest-SnapshotsActionsTest-950442099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a3f9acf6-a69c-4dd2-847b-ab9b425b06fa tempest-SnapshotsActionsTest-950442099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a3f9acf6-a69c-4dd2-847b-ab9b425b06fa tempest-SnapshotsActionsTest-950442099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:31 devstack sudo[84920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:53:31 devstack sudo[84920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:31 devstack sudo[84917]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3da7c772-0ebb-4dd5-b3de-a7f83264d241 tempest-VolumeQuotasAdminTestJSON-562775396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.414s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:31 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-3da7c772-0ebb-4dd5-b3de-a7f83264d241 tempest-VolumeQuotasAdminTestJSON-562775396 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:31 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-3da7c772-0ebb-4dd5-b3de-a7f83264d241 tempest-VolumeQuotasAdminTestJSON-562775396 None] Deleted volume successfully. Apr 21 20:53:31 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3da7c772-0ebb-4dd5-b3de-a7f83264d241 tempest-VolumeQuotasAdminTestJSON-562775396 None] Lock "cinder-d2e34ef7-9a4e-4f61-a85d-0253f969e207-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:31 devstack sudo[84920]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a3f9acf6-a69c-4dd2-847b-ab9b425b06fa tempest-SnapshotsActionsTest-950442099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.404s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:31 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-a3f9acf6-a69c-4dd2-847b-ab9b425b06fa tempest-SnapshotsActionsTest-950442099 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:31 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-a3f9acf6-a69c-4dd2-847b-ab9b425b06fa tempest-SnapshotsActionsTest-950442099 None] Deleted volume successfully. Apr 21 20:53:31 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a3f9acf6-a69c-4dd2-847b-ab9b425b06fa tempest-SnapshotsActionsTest-950442099 None] Lock "cinder-82fad66a-6cd7-43ff-8376-c63abfff8b8a-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Flow 'volume_create_manager' (36e445d2-0a6d-4666-b62c-fc183ed8ac64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab473e3b-2c98-4017-acd4-4be0a8c8f9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab473e3b-2c98-4017-acd4-4be0a8c8f9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1943345810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c49b65d-7012-4721-90d6-f9f899ece161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716ca00ed20a492ab5c7b51345343494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:32Z,use_quota=True,user_id='671294e5668b4f819a42455c8a983466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85cc8aff-dc47-4233-9932-4d608e294dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85cc8aff-dc47-4233-9932-4d608e294dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ee791e-c84a-407a-a590-c7fdd50d33d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ee791e-c84a-407a-a590-c7fdd50d33d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c49b65d-7012-4721-90d6-f9f899ece161', 'volume_name': 'volume-4c49b65d-7012-4721-90d6-f9f899ece161', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39220674-2360-45f8-816d-f2b7b3a6db0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39220674-2360-45f8-816d-f2b7b3a6db0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b4e8fd-7020-4491-a1e3-739d9575a63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:32 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Volume 4c49b65d-7012-4721-90d6-f9f899ece161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c49b65d-7012-4721-90d6-f9f899ece161', 'volume_size': 1} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1943345810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c49b65d-7012-4721-90d6-f9f899ece161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716ca00ed20a492ab5c7b51345343494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:32Z,use_quota=True,user_id='671294e5668b4f819a42455c8a983466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Creating volume 4c49b65d-7012-4721-90d6-f9f899ece161 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:32 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4c49b65d-7012-4721-90d6-f9f899ece161 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:32 devstack sudo[84924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4c49b65d-7012-4721-90d6-f9f899ece161 1073741824 Apr 21 20:53:32 devstack sudo[84924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-d0e16429-b834-4e8e-bbd1-9f2176a1f497 tempest-GroupsV320Test-1888584765 None] Created reservations ['015ac8f5-fc48-4333-b428-0c9f0479cbbf'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d0e16429-b834-4e8e-bbd1-9f2176a1f497 tempest-GroupsV320Test-1888584765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d0e16429-b834-4e8e-bbd1-9f2176a1f497 tempest-GroupsV320Test-1888584765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d0e16429-b834-4e8e-bbd1-9f2176a1f497 tempest-GroupsV320Test-1888584765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d0e16429-b834-4e8e-bbd1-9f2176a1f497 tempest-GroupsV320Test-1888584765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d0e16429-b834-4e8e-bbd1-9f2176a1f497 tempest-GroupsV320Test-1888584765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d0e16429-b834-4e8e-bbd1-9f2176a1f497 tempest-GroupsV320Test-1888584765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:32 devstack sudo[84926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:53:32 devstack sudo[84926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:32 devstack sudo[84924]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:32 devstack sudo[84926]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4c49b65d-7012-4721-90d6-f9f899ece161 1073741824" returned: 0 in 0.578s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d0e16429-b834-4e8e-bbd1-9f2176a1f497 tempest-GroupsV320Test-1888584765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.507s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-d0e16429-b834-4e8e-bbd1-9f2176a1f497 tempest-GroupsV320Test-1888584765 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:32 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-d0e16429-b834-4e8e-bbd1-9f2176a1f497 tempest-GroupsV320Test-1888584765 None] Delete group completed successfully. Apr 21 20:53:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4c49b65d-7012-4721-90d6-f9f899ece161 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:32 devstack sudo[84933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4c49b65d-7012-4721-90d6-f9f899ece161 Apr 21 20:53:32 devstack sudo[84933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:33 devstack sudo[84933]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4c49b65d-7012-4721-90d6-f9f899ece161" returned: 0 in 0.493s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b4e8fd-7020-4491-a1e3-739d9575a63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c49b65d-7012-4721-90d6-f9f899ece161', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da791cdf-6448-43cb-8053-26fb84ae6f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:33 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Volume volume-4c49b65d-7012-4721-90d6-f9f899ece161 (4c49b65d-7012-4721-90d6-f9f899ece161): created successfully Apr 21 20:53:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da791cdf-6448-43cb-8053-26fb84ae6f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Flow 'volume_create_manager' (36e445d2-0a6d-4666-b62c-fc183ed8ac64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:33 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-6fb3b18b-ef82-41e7-b060-f9b7626e13e1 tempest-VolumeQuotasAdminTestJSON-562775396 None] Created volume successfully. Apr 21 20:53:35 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:UPDATE=132,cinder:SELECT=123,cinder:DELETE=6,cinder:INSERT=37 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:53:35 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-2755698c-4df6-4f52-883a-5815ac6da91b tempest-VolumeQuotasAdminTestJSON-1184857349 None] Transfer volume completed successfully. Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5358cf80-d10b-436f-b0c5-b038b7a75628 tempest-VolumeQuotasAdminTestJSON-998246003 None] Acquiring lock "cinder-4c49b65d-7012-4721-90d6-f9f899ece161-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5358cf80-d10b-436f-b0c5-b038b7a75628 tempest-VolumeQuotasAdminTestJSON-998246003 None] Lock "cinder-4c49b65d-7012-4721-90d6-f9f899ece161-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:SELECT=120,cinder:INSERT=28,cinder:UPDATE=136,cinder:DELETE=10 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5358cf80-d10b-436f-b0c5-b038b7a75628 tempest-VolumeQuotasAdminTestJSON-998246003 None] Acquiring lock "cinder-quobyte-4c49b65d-7012-4721-90d6-f9f899ece161" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5358cf80-d10b-436f-b0c5-b038b7a75628 tempest-VolumeQuotasAdminTestJSON-998246003 None] Lock "cinder-quobyte-4c49b65d-7012-4721-90d6-f9f899ece161" acquired by "delete_volume" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[623ed74a-0cff-41e1-9b7a-f31ea029cb6e]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5358cf80-d10b-436f-b0c5-b038b7a75628 tempest-VolumeQuotasAdminTestJSON-998246003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4c49b65d-7012-4721-90d6-f9f899ece161 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:36 devstack sudo[84966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4c49b65d-7012-4721-90d6-f9f899ece161 Apr 21 20:53:36 devstack sudo[84966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Flow 'volume_create_manager' (12a33ee2-d28c-4749-a86a-921e451ee6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98553bbc-b4c0-4218-bb1d-b76992ccb4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98553bbc-b4c0-4218-bb1d-b76992ccb4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1038008421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad42357d-442b-4d4a-9201-6c32786777cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be638d9c74124ebc87402f9aaf2e65c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:36Z,use_quota=True,user_id='799c102913e04016b00361bee9dc6c22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac44b0b0-b3c6-47bb-9142-cc925a261364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac44b0b0-b3c6-47bb-9142-cc925a261364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468621a2-48f1-4740-9195-93195b13a80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468621a2-48f1-4740-9195-93195b13a80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad42357d-442b-4d4a-9201-6c32786777cf', 'volume_name': 'volume-ad42357d-442b-4d4a-9201-6c32786777cf', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c27bfb-8649-4f2d-9d26-9fd9490d6978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c27bfb-8649-4f2d-9d26-9fd9490d6978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6360c412-8367-4077-abc1-c932306e4cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:36 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Volume ad42357d-442b-4d4a-9201-6c32786777cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad42357d-442b-4d4a-9201-6c32786777cf', 'volume_size': 1} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1038008421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad42357d-442b-4d4a-9201-6c32786777cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be638d9c74124ebc87402f9aaf2e65c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:36Z,use_quota=True,user_id='799c102913e04016b00361bee9dc6c22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Creating volume ad42357d-442b-4d4a-9201-6c32786777cf {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:36 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad42357d-442b-4d4a-9201-6c32786777cf 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:36 devstack sudo[84969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad42357d-442b-4d4a-9201-6c32786777cf 1073741824 Apr 21 20:53:36 devstack sudo[84969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:36 devstack sudo[84966]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5358cf80-d10b-436f-b0c5-b038b7a75628 tempest-VolumeQuotasAdminTestJSON-998246003 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4c49b65d-7012-4721-90d6-f9f899ece161" returned: 0 in 0.563s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5358cf80-d10b-436f-b0c5-b038b7a75628 tempest-VolumeQuotasAdminTestJSON-998246003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4c49b65d-7012-4721-90d6-f9f899ece161 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:36 devstack sudo[85004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4c49b65d-7012-4721-90d6-f9f899ece161 Apr 21 20:53:36 devstack sudo[85004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:37 devstack sudo[84969]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad42357d-442b-4d4a-9201-6c32786777cf 1073741824" returned: 0 in 0.643s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad42357d-442b-4d4a-9201-6c32786777cf {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:37 devstack sudo[85009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad42357d-442b-4d4a-9201-6c32786777cf Apr 21 20:53:37 devstack sudo[85009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:37 devstack sudo[85004]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5358cf80-d10b-436f-b0c5-b038b7a75628 tempest-VolumeQuotasAdminTestJSON-998246003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4c49b65d-7012-4721-90d6-f9f899ece161" returned: 0 in 0.789s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:37 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5358cf80-d10b-436f-b0c5-b038b7a75628 tempest-VolumeQuotasAdminTestJSON-998246003 None] Lock "cinder-quobyte-4c49b65d-7012-4721-90d6-f9f899ece161" released by "delete_volume" :: held 1.444s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:37 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-5358cf80-d10b-436f-b0c5-b038b7a75628 tempest-VolumeQuotasAdminTestJSON-998246003 None] Created reservations ['9c9ab245-153e-4558-9d87-0b181a40a7e6', 'de1abb21-9295-4772-b7ba-c459a71c5aae', '965cbd5c-9d67-4e79-ba52-f3e1553326e9', '6a643820-fe82-40fb-9dc2-1d3cf25a0a53'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5358cf80-d10b-436f-b0c5-b038b7a75628 tempest-VolumeQuotasAdminTestJSON-998246003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5358cf80-d10b-436f-b0c5-b038b7a75628 tempest-VolumeQuotasAdminTestJSON-998246003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:37 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5358cf80-d10b-436f-b0c5-b038b7a75628 tempest-VolumeQuotasAdminTestJSON-998246003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:37 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5358cf80-d10b-436f-b0c5-b038b7a75628 tempest-VolumeQuotasAdminTestJSON-998246003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5358cf80-d10b-436f-b0c5-b038b7a75628 tempest-VolumeQuotasAdminTestJSON-998246003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5358cf80-d10b-436f-b0c5-b038b7a75628 tempest-VolumeQuotasAdminTestJSON-998246003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:37 devstack sudo[85012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:53:37 devstack sudo[85012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:37 devstack sudo[85009]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad42357d-442b-4d4a-9201-6c32786777cf" returned: 0 in 0.620s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:37 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:37 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6360c412-8367-4077-abc1-c932306e4cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad42357d-442b-4d4a-9201-6c32786777cf', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:37 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6107c8a-4578-4cd6-8afb-f4466d3516f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:37 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Volume volume-ad42357d-442b-4d4a-9201-6c32786777cf (ad42357d-442b-4d4a-9201-6c32786777cf): created successfully Apr 21 20:53:37 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6107c8a-4578-4cd6-8afb-f4466d3516f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:37 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Flow 'volume_create_manager' (12a33ee2-d28c-4749-a86a-921e451ee6b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:37 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-0ffebdfa-5f21-4053-a568-539e27d90f8c tempest-VolumeQuotasNegativeTestJSON-778151818 None] Created volume successfully. Apr 21 20:53:38 devstack sudo[85012]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5358cf80-d10b-436f-b0c5-b038b7a75628 tempest-VolumeQuotasAdminTestJSON-998246003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.486s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:38 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-5358cf80-d10b-436f-b0c5-b038b7a75628 tempest-VolumeQuotasAdminTestJSON-998246003 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:38 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-5358cf80-d10b-436f-b0c5-b038b7a75628 tempest-VolumeQuotasAdminTestJSON-998246003 None] Deleted volume successfully. Apr 21 20:53:38 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5358cf80-d10b-436f-b0c5-b038b7a75628 tempest-VolumeQuotasAdminTestJSON-998246003 None] Lock "cinder-4c49b65d-7012-4721-90d6-f9f899ece161-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:39 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-18eab996-2116-41d2-8eff-35fb28328559 tempest-VolumeQuotasNegativeTestJSON-778151818 None] Acquiring lock "cinder-ad42357d-442b-4d4a-9201-6c32786777cf-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:39 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-18eab996-2116-41d2-8eff-35fb28328559 tempest-VolumeQuotasNegativeTestJSON-778151818 None] Lock "cinder-ad42357d-442b-4d4a-9201-6c32786777cf-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:39 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-18eab996-2116-41d2-8eff-35fb28328559 tempest-VolumeQuotasNegativeTestJSON-778151818 None] Acquiring lock "cinder-quobyte-ad42357d-442b-4d4a-9201-6c32786777cf" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:39 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-18eab996-2116-41d2-8eff-35fb28328559 tempest-VolumeQuotasNegativeTestJSON-778151818 None] Lock "cinder-quobyte-ad42357d-442b-4d4a-9201-6c32786777cf" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:39 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8a3b7e-8db0-4fd6-baa6-df8c7032b753]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-18eab996-2116-41d2-8eff-35fb28328559 tempest-VolumeQuotasNegativeTestJSON-778151818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad42357d-442b-4d4a-9201-6c32786777cf {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:39 devstack sudo[85063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad42357d-442b-4d4a-9201-6c32786777cf Apr 21 20:53:39 devstack sudo[85063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:40 devstack sudo[85063]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-18eab996-2116-41d2-8eff-35fb28328559 tempest-VolumeQuotasNegativeTestJSON-778151818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad42357d-442b-4d4a-9201-6c32786777cf" returned: 0 in 0.751s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-18eab996-2116-41d2-8eff-35fb28328559 tempest-VolumeQuotasNegativeTestJSON-778151818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad42357d-442b-4d4a-9201-6c32786777cf {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:40 devstack sudo[85069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad42357d-442b-4d4a-9201-6c32786777cf Apr 21 20:53:40 devstack sudo[85069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:41 devstack sudo[85069]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-18eab996-2116-41d2-8eff-35fb28328559 tempest-VolumeQuotasNegativeTestJSON-778151818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad42357d-442b-4d4a-9201-6c32786777cf" returned: 0 in 0.495s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:41 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-18eab996-2116-41d2-8eff-35fb28328559 tempest-VolumeQuotasNegativeTestJSON-778151818 None] Lock "cinder-quobyte-ad42357d-442b-4d4a-9201-6c32786777cf" released by "delete_volume" :: held 1.298s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:41 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-18eab996-2116-41d2-8eff-35fb28328559 tempest-VolumeQuotasNegativeTestJSON-778151818 None] Created reservations ['97f3aeb8-b8ee-4a43-a2cd-1e4fc6ed18b3', '50310414-d629-4837-a460-0cce80654b0d', '0af80bda-ee33-4421-a208-2b98edfa27aa', '4d7642bb-0a4a-47d7-a28f-433eb3b56344'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-18eab996-2116-41d2-8eff-35fb28328559 tempest-VolumeQuotasNegativeTestJSON-778151818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-18eab996-2116-41d2-8eff-35fb28328559 tempest-VolumeQuotasNegativeTestJSON-778151818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:41 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-18eab996-2116-41d2-8eff-35fb28328559 tempest-VolumeQuotasNegativeTestJSON-778151818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:41 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-18eab996-2116-41d2-8eff-35fb28328559 tempest-VolumeQuotasNegativeTestJSON-778151818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-18eab996-2116-41d2-8eff-35fb28328559 tempest-VolumeQuotasNegativeTestJSON-778151818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-18eab996-2116-41d2-8eff-35fb28328559 tempest-VolumeQuotasNegativeTestJSON-778151818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:41 devstack sudo[85073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:53:41 devstack sudo[85073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:41 devstack sudo[85073]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-18eab996-2116-41d2-8eff-35fb28328559 tempest-VolumeQuotasNegativeTestJSON-778151818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.554s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:41 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-18eab996-2116-41d2-8eff-35fb28328559 tempest-VolumeQuotasNegativeTestJSON-778151818 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:41 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-18eab996-2116-41d2-8eff-35fb28328559 tempest-VolumeQuotasNegativeTestJSON-778151818 None] Deleted volume successfully. Apr 21 20:53:41 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-18eab996-2116-41d2-8eff-35fb28328559 tempest-VolumeQuotasNegativeTestJSON-778151818 None] Lock "cinder-ad42357d-442b-4d4a-9201-6c32786777cf-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:44 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Flow 'volume_create_manager' (c58b59d4-266b-47c4-b258-c154cbbe1ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6cc7dbb-cecd-40f4-8fb6-3a881c6089b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6cc7dbb-cecd-40f4-8fb6-3a881c6089b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1973892324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d70f099f-d083-48c8-aeeb-8dafd646fa30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8ea877125f4b35b6a339e3f0e7c3ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:44Z,use_quota=True,user_id='15f9f79daef84743b3c88e0dd268183a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ffa488-5e2b-411e-91ba-2d21a6d77dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ffa488-5e2b-411e-91ba-2d21a6d77dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a2a8a6-8e9e-4943-a9e9-f256243d6234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a2a8a6-8e9e-4943-a9e9-f256243d6234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd70f099f-d083-48c8-aeeb-8dafd646fa30', 'volume_name': 'volume-d70f099f-d083-48c8-aeeb-8dafd646fa30', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0814091-c650-4ac7-83f3-ca2301178835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0814091-c650-4ac7-83f3-ca2301178835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc927ea7-b816-4071-9ab6-69aa8a966624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:44 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Volume d70f099f-d083-48c8-aeeb-8dafd646fa30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d70f099f-d083-48c8-aeeb-8dafd646fa30', 'volume_size': 1} Apr 21 20:53:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:44 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1973892324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d70f099f-d083-48c8-aeeb-8dafd646fa30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8ea877125f4b35b6a339e3f0e7c3ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:44Z,use_quota=True,user_id='15f9f79daef84743b3c88e0dd268183a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:44 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Creating volume d70f099f-d083-48c8-aeeb-8dafd646fa30 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:44 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:44 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:44 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:44 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:53:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:44 devstack sudo[85082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30 1073741824 Apr 21 20:53:44 devstack sudo[85082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:45 devstack sudo[85082]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30 1073741824" returned: 0 in 0.586s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:45 devstack sudo[85087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30 Apr 21 20:53:45 devstack sudo[85087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:45 devstack sudo[85087]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30" returned: 0 in 0.495s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc927ea7-b816-4071-9ab6-69aa8a966624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d70f099f-d083-48c8-aeeb-8dafd646fa30', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e77077-57b4-4d1d-b0ec-a5b04a1a2683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:45 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Volume volume-d70f099f-d083-48c8-aeeb-8dafd646fa30 (d70f099f-d083-48c8-aeeb-8dafd646fa30): created successfully Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e77077-57b4-4d1d-b0ec-a5b04a1a2683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Flow 'volume_create_manager' (c58b59d4-266b-47c4-b258-c154cbbe1ecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:45 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-3e6270d5-b3eb-45bd-ab02-70ae06b5f696 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Created volume successfully. Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Flow 'volume_create_manager' (3e8093a4-b4de-458f-ad08-ac9f8d6b2e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56394bd2-8a62-4bb8-ad5b-158a783e0ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56394bd2-8a62-4bb8-ad5b-158a783e0ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-660898283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e43646e3-1144-4f9c-bd29-610c49fbd7cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97956900398d472eadb96ea471ce5e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:46Z,use_quota=True,user_id='ab7e8b90d0e44c6a8dec789574aee91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e9dd87-59fb-4170-9db5-e55666b7d8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e9dd87-59fb-4170-9db5-e55666b7d8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb72da8-d134-4880-a15e-6f1dfb1e6c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb72da8-d134-4880-a15e-6f1dfb1e6c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e43646e3-1144-4f9c-bd29-610c49fbd7cd', 'volume_name': 'volume-e43646e3-1144-4f9c-bd29-610c49fbd7cd', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99293935-0f62-4863-b730-731ad90cdf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99293935-0f62-4863-b730-731ad90cdf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9239ef-bf99-44af-b986-e884aff50f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:45 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Volume e43646e3-1144-4f9c-bd29-610c49fbd7cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e43646e3-1144-4f9c-bd29-610c49fbd7cd', 'volume_size': 1} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-660898283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e43646e3-1144-4f9c-bd29-610c49fbd7cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97956900398d472eadb96ea471ce5e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:46Z,use_quota=True,user_id='ab7e8b90d0e44c6a8dec789574aee91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Creating volume e43646e3-1144-4f9c-bd29-610c49fbd7cd {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:45 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:53:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e43646e3-1144-4f9c-bd29-610c49fbd7cd 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:46 devstack sudo[85090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e43646e3-1144-4f9c-bd29-610c49fbd7cd 1073741824 Apr 21 20:53:46 devstack sudo[85090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:46 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Flow 'volume_create_manager' (7777319e-ac31-4010-ab87-34e23cd4a495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5960b453-2d98-4d81-909d-d3fbdb06331c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5960b453-2d98-4d81-909d-d3fbdb06331c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1995084318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc3fc68-391c-422c-8452-3c0bf8d1b4b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a317c1f0de4e436ba39c8ac8f0929576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:46Z,use_quota=True,user_id='f1067d7981ca4ae68d8cd4f0a78ef311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e01772b-fa69-4cb6-8667-c9205c9f260e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e01772b-fa69-4cb6-8667-c9205c9f260e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6abb339-46b9-47bd-a4ca-dd41cc1fde62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6abb339-46b9-47bd-a4ca-dd41cc1fde62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccc3fc68-391c-422c-8452-3c0bf8d1b4b1', 'volume_name': 'volume-ccc3fc68-391c-422c-8452-3c0bf8d1b4b1', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c82d618-e35e-4061-a4ce-fb4d71da7bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c82d618-e35e-4061-a4ce-fb4d71da7bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1bbe2c8-d0ef-49cf-aff6-633ac0375995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:46 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Volume ccc3fc68-391c-422c-8452-3c0bf8d1b4b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccc3fc68-391c-422c-8452-3c0bf8d1b4b1', 'volume_size': 1} Apr 21 20:53:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:46 devstack sudo[85090]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e43646e3-1144-4f9c-bd29-610c49fbd7cd 1073741824" returned: 0 in 0.531s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e43646e3-1144-4f9c-bd29-610c49fbd7cd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:46 devstack sudo[85095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e43646e3-1144-4f9c-bd29-610c49fbd7cd Apr 21 20:53:46 devstack sudo[85095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-39a0140d-6bce-4f2a-aba4-2da90eef4480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:47 devstack sudo[85095]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e43646e3-1144-4f9c-bd29-610c49fbd7cd" returned: 0 in 0.523s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.641s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1995084318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc3fc68-391c-422c-8452-3c0bf8d1b4b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a317c1f0de4e436ba39c8ac8f0929576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:46Z,use_quota=True,user_id='f1067d7981ca4ae68d8cd4f0a78ef311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Creating volume ccc3fc68-391c-422c-8452-3c0bf8d1b4b1 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:47 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:53:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ccc3fc68-391c-422c-8452-3c0bf8d1b4b1 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:47 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9239ef-bf99-44af-b986-e884aff50f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e43646e3-1144-4f9c-bd29-610c49fbd7cd', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:47 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b881fc1d-08b0-4e23-9a3e-8375eec21f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:47 devstack sudo[85098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ccc3fc68-391c-422c-8452-3c0bf8d1b4b1 1073741824 Apr 21 20:53:47 devstack sudo[85098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:47 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Volume volume-e43646e3-1144-4f9c-bd29-610c49fbd7cd (e43646e3-1144-4f9c-bd29-610c49fbd7cd): created successfully Apr 21 20:53:47 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b881fc1d-08b0-4e23-9a3e-8375eec21f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:47 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Flow 'volume_create_manager' (3e8093a4-b4de-458f-ad08-ac9f8d6b2e7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:47 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-da58d66e-08c2-4392-a143-5d65ee6fabfd tempest-VolumesListAdminTestJSON-1994105380 None] Created volume successfully. Apr 21 20:53:47 devstack sudo[85098]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ccc3fc68-391c-422c-8452-3c0bf8d1b4b1 1073741824" returned: 0 in 0.501s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ccc3fc68-391c-422c-8452-3c0bf8d1b4b1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:47 devstack sudo[85103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ccc3fc68-391c-422c-8452-3c0bf8d1b4b1 Apr 21 20:53:47 devstack sudo[85103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:48 devstack sudo[85103]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ccc3fc68-391c-422c-8452-3c0bf8d1b4b1" returned: 0 in 0.504s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-39a0140d-6bce-4f2a-aba4-2da90eef4480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.278s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1bbe2c8-d0ef-49cf-aff6-633ac0375995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccc3fc68-391c-422c-8452-3c0bf8d1b4b1', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ac2a23-88f5-4028-bbda-d37a8b1eecb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-39a0140d-6bce-4f2a-aba4-2da90eef4480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Creating offline snapshot b7a8edf3-a376-45ab-837c-b1dc37454b7b of volume d70f099f-d083-48c8-aeeb-8dafd646fa30 {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:53:48 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Volume volume-ccc3fc68-391c-422c-8452-3c0bf8d1b4b1 (ccc3fc68-391c-422c-8452-3c0bf8d1b4b1): created successfully Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ac2a23-88f5-4028-bbda-d37a8b1eecb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Flow 'volume_create_manager' (7777319e-ac31-4010-ab87-34e23cd4a495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e1cea1-e2fb-45af-a165-8296ed9695b1]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-39a0140d-6bce-4f2a-aba4-2da90eef4480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:48 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-60207948-6661-409d-b952-0e41092b5f40 tempest-VolumesServicesTestJSON-1725955415 None] Created volume successfully. Apr 21 20:53:48 devstack sudo[85109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30 Apr 21 20:53:48 devstack sudo[85109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Flow 'volume_create_manager' (e92e0385-77ce-4cf3-aacb-ba6f89fa0910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f80cc2-d36a-4f38-8e1e-ede7ed8e92be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f80cc2-d36a-4f38-8e1e-ede7ed8e92be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1740835930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af53a9d3-6e7e-422d-b2e8-5f345f60d26b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97956900398d472eadb96ea471ce5e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:48Z,use_quota=True,user_id='ab7e8b90d0e44c6a8dec789574aee91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f519219-dcb6-4eff-b2ac-27d6f3d73465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f519219-dcb6-4eff-b2ac-27d6f3d73465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d6b7f6-9f21-4071-9267-35b85ded6ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d6b7f6-9f21-4071-9267-35b85ded6ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af53a9d3-6e7e-422d-b2e8-5f345f60d26b', 'volume_name': 'volume-af53a9d3-6e7e-422d-b2e8-5f345f60d26b', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea15862-a3a7-4468-94aa-eff9867f042d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea15862-a3a7-4468-94aa-eff9867f042d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51c2e00-b554-4bbf-bbe9-9f5860d48544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:48 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Volume af53a9d3-6e7e-422d-b2e8-5f345f60d26b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af53a9d3-6e7e-422d-b2e8-5f345f60d26b', 'volume_size': 1} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9c70dc4f-e54e-4b0a-b5ef-8d53f842f6d2 tempest-VolumesServicesTestJSON-1725955415 None] Acquiring lock "cinder-ccc3fc68-391c-422c-8452-3c0bf8d1b4b1-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9c70dc4f-e54e-4b0a-b5ef-8d53f842f6d2 tempest-VolumesServicesTestJSON-1725955415 None] Lock "cinder-ccc3fc68-391c-422c-8452-3c0bf8d1b4b1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9c70dc4f-e54e-4b0a-b5ef-8d53f842f6d2 tempest-VolumesServicesTestJSON-1725955415 None] Acquiring lock "cinder-quobyte-ccc3fc68-391c-422c-8452-3c0bf8d1b4b1" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9c70dc4f-e54e-4b0a-b5ef-8d53f842f6d2 tempest-VolumesServicesTestJSON-1725955415 None] Lock "cinder-quobyte-ccc3fc68-391c-422c-8452-3c0bf8d1b4b1" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb547e1-1229-4f4d-9533-68a553297c71]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9c70dc4f-e54e-4b0a-b5ef-8d53f842f6d2 tempest-VolumesServicesTestJSON-1725955415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ccc3fc68-391c-422c-8452-3c0bf8d1b4b1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:48 devstack sudo[85109]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:48 devstack sudo[85115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ccc3fc68-391c-422c-8452-3c0bf8d1b4b1 Apr 21 20:53:48 devstack sudo[85115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-39a0140d-6bce-4f2a-aba4-2da90eef4480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30" returned: 0 in 0.537s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-39a0140d-6bce-4f2a-aba4-2da90eef4480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.b7a8edf3-a376-45ab-837c-b1dc37454b7b 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:48 devstack sudo[85118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.b7a8edf3-a376-45ab-837c-b1dc37454b7b 1G Apr 21 20:53:48 devstack sudo[85118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:49 devstack sudo[85115]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9c70dc4f-e54e-4b0a-b5ef-8d53f842f6d2 tempest-VolumesServicesTestJSON-1725955415 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ccc3fc68-391c-422c-8452-3c0bf8d1b4b1" returned: 0 in 0.522s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9c70dc4f-e54e-4b0a-b5ef-8d53f842f6d2 tempest-VolumesServicesTestJSON-1725955415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ccc3fc68-391c-422c-8452-3c0bf8d1b4b1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:49 devstack sudo[85141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ccc3fc68-391c-422c-8452-3c0bf8d1b4b1 Apr 21 20:53:49 devstack sudo[85141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:49 devstack sudo[85118]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-39a0140d-6bce-4f2a-aba4-2da90eef4480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.b7a8edf3-a376-45ab-837c-b1dc37454b7b 1G" returned: 0 in 0.495s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-39a0140d-6bce-4f2a-aba4-2da90eef4480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d70f099f-d083-48c8-aeeb-8dafd646fa30 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.b7a8edf3-a376-45ab-837c-b1dc37454b7b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:49 devstack sudo[85143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d70f099f-d083-48c8-aeeb-8dafd646fa30 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.b7a8edf3-a376-45ab-837c-b1dc37454b7b Apr 21 20:53:49 devstack sudo[85143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:49 devstack sudo[85141]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9c70dc4f-e54e-4b0a-b5ef-8d53f842f6d2 tempest-VolumesServicesTestJSON-1725955415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ccc3fc68-391c-422c-8452-3c0bf8d1b4b1" returned: 0 in 0.422s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:49 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9c70dc4f-e54e-4b0a-b5ef-8d53f842f6d2 tempest-VolumesServicesTestJSON-1725955415 None] Lock "cinder-quobyte-ccc3fc68-391c-422c-8452-3c0bf8d1b4b1" released by "delete_volume" :: held 0.966s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:49 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-9c70dc4f-e54e-4b0a-b5ef-8d53f842f6d2 tempest-VolumesServicesTestJSON-1725955415 None] Created reservations ['3e6612b7-677a-4b27-be54-e7830f878c24', '4bcad907-7775-41b9-ae1e-a77a1d11513d', '51f72475-e0a9-4064-90a9-a218d3de2ec4', 'fbbe8bc3-fccd-4271-9cdb-f4a42fd9d899'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9c70dc4f-e54e-4b0a-b5ef-8d53f842f6d2 tempest-VolumesServicesTestJSON-1725955415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9c70dc4f-e54e-4b0a-b5ef-8d53f842f6d2 tempest-VolumesServicesTestJSON-1725955415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:49 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9c70dc4f-e54e-4b0a-b5ef-8d53f842f6d2 tempest-VolumesServicesTestJSON-1725955415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:49 devstack sudo[85143]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:49 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9c70dc4f-e54e-4b0a-b5ef-8d53f842f6d2 tempest-VolumesServicesTestJSON-1725955415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9c70dc4f-e54e-4b0a-b5ef-8d53f842f6d2 tempest-VolumesServicesTestJSON-1725955415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9c70dc4f-e54e-4b0a-b5ef-8d53f842f6d2 tempest-VolumesServicesTestJSON-1725955415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-39a0140d-6bce-4f2a-aba4-2da90eef4480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d70f099f-d083-48c8-aeeb-8dafd646fa30 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.b7a8edf3-a376-45ab-837c-b1dc37454b7b" returned: 0 in 0.482s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:49 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-39a0140d-6bce-4f2a-aba4-2da90eef4480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.b7a8edf3-a376-45ab-837c-b1dc37454b7b is being set with open permissions: ugo+rw Apr 21 20:53:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-39a0140d-6bce-4f2a-aba4-2da90eef4480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.b7a8edf3-a376-45ab-837c-b1dc37454b7b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:49 devstack sudo[85149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:53:49 devstack sudo[85149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:49 devstack sudo[85150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.b7a8edf3-a376-45ab-837c-b1dc37454b7b Apr 21 20:53:49 devstack sudo[85150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:50 devstack sudo[85150]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-39a0140d-6bce-4f2a-aba4-2da90eef4480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.b7a8edf3-a376-45ab-837c-b1dc37454b7b" returned: 0 in 0.437s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-39a0140d-6bce-4f2a-aba4-2da90eef4480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:50 devstack sudo[85149]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9c70dc4f-e54e-4b0a-b5ef-8d53f842f6d2 tempest-VolumesServicesTestJSON-1725955415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.487s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:50 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-9c70dc4f-e54e-4b0a-b5ef-8d53f842f6d2 tempest-VolumesServicesTestJSON-1725955415 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:50 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-9c70dc4f-e54e-4b0a-b5ef-8d53f842f6d2 tempest-VolumesServicesTestJSON-1725955415 None] Deleted volume successfully. Apr 21 20:53:50 devstack sudo[85155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.info Apr 21 20:53:50 devstack sudo[85155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:50 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9c70dc4f-e54e-4b0a-b5ef-8d53f842f6d2 tempest-VolumesServicesTestJSON-1725955415 None] Lock "cinder-ccc3fc68-391c-422c-8452-3c0bf8d1b4b1-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:50 devstack sudo[85155]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-39a0140d-6bce-4f2a-aba4-2da90eef4480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.info" returned: 0 in 0.511s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:50 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-39a0140d-6bce-4f2a-aba4-2da90eef4480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.info is being set with open permissions: ugo+rw Apr 21 20:53:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-39a0140d-6bce-4f2a-aba4-2da90eef4480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:50 devstack sudo[85158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.info Apr 21 20:53:50 devstack sudo[85158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:51 devstack sudo[85158]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-39a0140d-6bce-4f2a-aba4-2da90eef4480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.info" returned: 0 in 0.476s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-39a0140d-6bce-4f2a-aba4-2da90eef4480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.042s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.682s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:51 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1740835930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af53a9d3-6e7e-422d-b2e8-5f345f60d26b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97956900398d472eadb96ea471ce5e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:48Z,use_quota=True,user_id='ab7e8b90d0e44c6a8dec789574aee91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:51 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Creating volume af53a9d3-6e7e-422d-b2e8-5f345f60d26b {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:51 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:51 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:51 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:51 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:53:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-af53a9d3-6e7e-422d-b2e8-5f345f60d26b 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:51 devstack sudo[85168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-af53a9d3-6e7e-422d-b2e8-5f345f60d26b 1073741824 Apr 21 20:53:51 devstack sudo[85168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:51 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-39a0140d-6bce-4f2a-aba4-2da90eef4480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Create snapshot completed successfully Apr 21 20:53:51 devstack sudo[85168]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-af53a9d3-6e7e-422d-b2e8-5f345f60d26b 1073741824" returned: 0 in 0.582s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-af53a9d3-6e7e-422d-b2e8-5f345f60d26b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:51 devstack sudo[85176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-af53a9d3-6e7e-422d-b2e8-5f345f60d26b Apr 21 20:53:51 devstack sudo[85176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:52 devstack sudo[85176]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-af53a9d3-6e7e-422d-b2e8-5f345f60d26b" returned: 0 in 0.483s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:52 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51c2e00-b554-4bbf-bbe9-9f5860d48544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af53a9d3-6e7e-422d-b2e8-5f345f60d26b', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8323bba-7fd9-428e-a4ba-a8fa244e21c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:52 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Volume volume-af53a9d3-6e7e-422d-b2e8-5f345f60d26b (af53a9d3-6e7e-422d-b2e8-5f345f60d26b): created successfully Apr 21 20:53:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8323bba-7fd9-428e-a4ba-a8fa244e21c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Flow 'volume_create_manager' (e92e0385-77ce-4cf3-aacb-ba6f89fa0910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:52 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-2cff8fc9-504b-48e0-9b7a-567566230503 tempest-VolumesListAdminTestJSON-1994105380 None] Created volume successfully. Apr 21 20:53:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-aa039225-9215-4e67-941d-d455fd48c03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Acquiring lock "cinder-b7a8edf3-a376-45ab-837c-b1dc37454b7b-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-aa039225-9215-4e67-941d-d455fd48c03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Lock "cinder-b7a8edf3-a376-45ab-837c-b1dc37454b7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-aa039225-9215-4e67-941d-d455fd48c03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Acquiring lock "cinder-quobyte-d70f099f-d083-48c8-aeeb-8dafd646fa30" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-aa039225-9215-4e67-941d-d455fd48c03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Lock "cinder-quobyte-d70f099f-d083-48c8-aeeb-8dafd646fa30" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-aa039225-9215-4e67-941d-d455fd48c03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Acquiring lock "cinder-quobyte-b7a8edf3-a376-45ab-837c-b1dc37454b7b" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-aa039225-9215-4e67-941d-d455fd48c03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Lock "cinder-quobyte-b7a8edf3-a376-45ab-837c-b1dc37454b7b" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:52 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-aa039225-9215-4e67-941d-d455fd48c03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Deleting offline snapshot b7a8edf3-a376-45ab-837c-b1dc37454b7b of volume d70f099f-d083-48c8-aeeb-8dafd646fa30 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:53:52 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-aa039225-9215-4e67-941d-d455fd48c03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] snapshot_file for this snap is: volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.b7a8edf3-a376-45ab-837c-b1dc37454b7b {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:53:52 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e75677-b221-42ab-a796-23117443d012]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aa039225-9215-4e67-941d-d455fd48c03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.b7a8edf3-a376-45ab-837c-b1dc37454b7b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:52 devstack sudo[85179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.b7a8edf3-a376-45ab-837c-b1dc37454b7b Apr 21 20:53:52 devstack sudo[85179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Flow 'volume_create_manager' (b11b87c2-30a4-45bf-8e65-28e69659f016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccdfbac0-be2e-42fc-b929-2d512b859057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccdfbac0-be2e-42fc-b929-2d512b859057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1989456195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c638f112-df01-49d3-bb3c-2e2af762c2f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97956900398d472eadb96ea471ce5e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:53Z,use_quota=True,user_id='ab7e8b90d0e44c6a8dec789574aee91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d746e4f1-40e2-409e-8481-a9342e09decb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d746e4f1-40e2-409e-8481-a9342e09decb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30b4870-e5e9-4683-b63c-f953949b4ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30b4870-e5e9-4683-b63c-f953949b4ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c638f112-df01-49d3-bb3c-2e2af762c2f8', 'volume_name': 'volume-c638f112-df01-49d3-bb3c-2e2af762c2f8', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be98f6e6-153a-49b8-ae35-7ca298fb4255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be98f6e6-153a-49b8-ae35-7ca298fb4255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:53 devstack sudo[85179]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e700b48-4acd-45d4-ae70-f1334ba249dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:53 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Volume c638f112-df01-49d3-bb3c-2e2af762c2f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c638f112-df01-49d3-bb3c-2e2af762c2f8', 'volume_size': 1} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1989456195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c638f112-df01-49d3-bb3c-2e2af762c2f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97956900398d472eadb96ea471ce5e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:53Z,use_quota=True,user_id='ab7e8b90d0e44c6a8dec789574aee91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Creating volume c638f112-df01-49d3-bb3c-2e2af762c2f8 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:53 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c638f112-df01-49d3-bb3c-2e2af762c2f8 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aa039225-9215-4e67-941d-d455fd48c03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.b7a8edf3-a376-45ab-837c-b1dc37454b7b" returned: 0 in 0.799s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-aa039225-9215-4e67-941d-d455fd48c03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d70f099f-d083-48c8-aeeb-8dafd646fa30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[932b5b83-1fa3-41ee-b9d5-6618ec95ba46]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aa039225-9215-4e67-941d-d455fd48c03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:53 devstack sudo[85209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c638f112-df01-49d3-bb3c-2e2af762c2f8 1073741824 Apr 21 20:53:53 devstack sudo[85209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:53 devstack sudo[85210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30 Apr 21 20:53:53 devstack sudo[85210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG oslo_service.periodic_task [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81957) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:53 devstack sudo[85222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:53:53 devstack sudo[85222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:54 devstack sudo[85210]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aa039225-9215-4e67-941d-d455fd48c03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30" returned: 0 in 0.792s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aa039225-9215-4e67-941d-d455fd48c03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.b7a8edf3-a376-45ab-837c-b1dc37454b7b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:54 devstack sudo[85225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.b7a8edf3-a376-45ab-837c-b1dc37454b7b Apr 21 20:53:54 devstack sudo[85225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:54 devstack sudo[85209]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c638f112-df01-49d3-bb3c-2e2af762c2f8 1073741824" returned: 0 in 0.911s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c638f112-df01-49d3-bb3c-2e2af762c2f8 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:54 devstack sudo[85227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c638f112-df01-49d3-bb3c-2e2af762c2f8 Apr 21 20:53:54 devstack sudo[85227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:54 devstack sudo[85222]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.772s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:54 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:54 devstack sudo[85227]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c638f112-df01-49d3-bb3c-2e2af762c2f8" returned: 0 in 0.730s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:54 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:54 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e700b48-4acd-45d4-ae70-f1334ba249dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c638f112-df01-49d3-bb3c-2e2af762c2f8', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:54 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7fdc586-b802-49ab-9fad-9e49eb622fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:54 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Volume volume-c638f112-df01-49d3-bb3c-2e2af762c2f8 (c638f112-df01-49d3-bb3c-2e2af762c2f8): created successfully Apr 21 20:53:54 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7fdc586-b802-49ab-9fad-9e49eb622fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:54 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Flow 'volume_create_manager' (b11b87c2-30a4-45bf-8e65-28e69659f016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:54 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-1fb876c6-0e76-4288-9cee-cee315fa0e54 tempest-VolumesListAdminTestJSON-1994105380 None] Created volume successfully. Apr 21 20:53:55 devstack sudo[85225]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aa039225-9215-4e67-941d-d455fd48c03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.b7a8edf3-a376-45ab-837c-b1dc37454b7b" returned: 0 in 1.121s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aa039225-9215-4e67-941d-d455fd48c03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.b7a8edf3-a376-45ab-837c-b1dc37454b7b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:55 devstack sudo[85269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.b7a8edf3-a376-45ab-837c-b1dc37454b7b Apr 21 20:53:55 devstack sudo[85269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:55 devstack sudo[85269]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Flow 'volume_create_manager' (c7c6cd19-4363-47e6-9f88-27c11aea5885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7dd303-c83c-47df-b4d8-3579635a1042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aa039225-9215-4e67-941d-d455fd48c03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30.b7a8edf3-a376-45ab-837c-b1dc37454b7b" returned: 0 in 0.622s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7dd303-c83c-47df-b4d8-3579635a1042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ccf8438-c5e7-4e45-8662-2797b3797f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764a0e8bc7b9498c9f1c0c67c1316a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:56Z,use_quota=True,user_id='ee36d17c1660417e93a787cf7b3f3ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e833c20-b849-41a3-89de-3085eb17a417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e833c20-b849-41a3-89de-3085eb17a417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ad15d6-3bf5-4d65-b7fb-abb0b64ffef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ad15d6-3bf5-4d65-b7fb-abb0b64ffef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ccf8438-c5e7-4e45-8662-2797b3797f7a', 'volume_name': 'volume-6ccf8438-c5e7-4e45-8662-2797b3797f7a', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cacb3ae5-d551-4104-8a69-787223b37b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cacb3ae5-d551-4104-8a69-787223b37b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3387ebd4-9790-47c0-9636-323bd71c2052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:55 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Volume 6ccf8438-c5e7-4e45-8662-2797b3797f7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ccf8438-c5e7-4e45-8662-2797b3797f7a', 'volume_size': 1} Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ccf8438-c5e7-4e45-8662-2797b3797f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764a0e8bc7b9498c9f1c0c67c1316a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:56Z,use_quota=True,user_id='ee36d17c1660417e93a787cf7b3f3ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Creating volume 6ccf8438-c5e7-4e45-8662-2797b3797f7a {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:55 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6ccf8438-c5e7-4e45-8662-2797b3797f7a 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:55 devstack sudo[85273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6ccf8438-c5e7-4e45-8662-2797b3797f7a 1073741824 Apr 21 20:53:55 devstack sudo[85273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-aa039225-9215-4e67-941d-d455fd48c03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Lock "cinder-quobyte-b7a8edf3-a376-45ab-837c-b1dc37454b7b" released by "_delete_snapshot" :: held 3.468s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-aa039225-9215-4e67-941d-d455fd48c03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Lock "cinder-quobyte-d70f099f-d083-48c8-aeeb-8dafd646fa30" released by "delete_snapshot" :: held 3.484s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-aa039225-9215-4e67-941d-d455fd48c03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Created reservations ['3f81ef5a-20a0-46a7-8246-67d772448bb2', '0d73524b-02cd-433b-b51f-8290c1a8cbe0', '583485e6-b74c-42fe-bc5b-30031bfa8f25', '523a2180-23aa-4a76-96d9-7a338e50d744'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:55 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-aa039225-9215-4e67-941d-d455fd48c03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Delete snapshot completed successfully. Apr 21 20:53:55 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-aa039225-9215-4e67-941d-d455fd48c03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Lock "cinder-b7a8edf3-a376-45ab-837c-b1dc37454b7b-delete_snapshot" released by "delete_snapshot" :: held 3.582s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:56 devstack sudo[85273]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6ccf8438-c5e7-4e45-8662-2797b3797f7a 1073741824" returned: 0 in 0.637s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6ccf8438-c5e7-4e45-8662-2797b3797f7a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:56 devstack sudo[85278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6ccf8438-c5e7-4e45-8662-2797b3797f7a Apr 21 20:53:56 devstack sudo[85278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:56 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e98b5a1a-49f4-4767-aeb9-c12b0313e681 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Acquiring lock "cinder-d70f099f-d083-48c8-aeeb-8dafd646fa30-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:56 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e98b5a1a-49f4-4767-aeb9-c12b0313e681 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Lock "cinder-d70f099f-d083-48c8-aeeb-8dafd646fa30-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:56 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e98b5a1a-49f4-4767-aeb9-c12b0313e681 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Acquiring lock "cinder-quobyte-d70f099f-d083-48c8-aeeb-8dafd646fa30" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:56 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e98b5a1a-49f4-4767-aeb9-c12b0313e681 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Lock "cinder-quobyte-d70f099f-d083-48c8-aeeb-8dafd646fa30" acquired by "delete_volume" :: waited 0.015s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:56 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f74f6f5-c5a7-4f37-97ec-89920bc8edfc]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e98b5a1a-49f4-4767-aeb9-c12b0313e681 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:56 devstack sudo[85280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30 Apr 21 20:53:56 devstack sudo[85280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:57 devstack sudo[85278]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6ccf8438-c5e7-4e45-8662-2797b3797f7a" returned: 0 in 0.747s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:57 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3387ebd4-9790-47c0-9636-323bd71c2052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ccf8438-c5e7-4e45-8662-2797b3797f7a', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b370ca87-85cf-4b17-a98e-f320fe77b09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:57 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Volume volume-6ccf8438-c5e7-4e45-8662-2797b3797f7a (6ccf8438-c5e7-4e45-8662-2797b3797f7a): created successfully Apr 21 20:53:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b370ca87-85cf-4b17-a98e-f320fe77b09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Flow 'volume_create_manager' (c7c6cd19-4363-47e6-9f88-27c11aea5885) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:57 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-fc38e58e-153f-4ecb-bf01-258a570b8c3c tempest-VolumesListAdminTestJSON-1896673150 None] Created volume successfully. Apr 21 20:53:57 devstack sudo[85280]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e98b5a1a-49f4-4767-aeb9-c12b0313e681 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30" returned: 0 in 0.621s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e98b5a1a-49f4-4767-aeb9-c12b0313e681 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:57 devstack sudo[85287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30 Apr 21 20:53:57 devstack sudo[85287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:57 devstack sudo[85287]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e98b5a1a-49f4-4767-aeb9-c12b0313e681 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d70f099f-d083-48c8-aeeb-8dafd646fa30" returned: 0 in 0.474s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:57 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e98b5a1a-49f4-4767-aeb9-c12b0313e681 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Lock "cinder-quobyte-d70f099f-d083-48c8-aeeb-8dafd646fa30" released by "delete_volume" :: held 1.133s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:57 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-e98b5a1a-49f4-4767-aeb9-c12b0313e681 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Created reservations ['cae245f1-4b0a-48a8-afe8-7f3eae1f383a', 'ccb452be-ceba-4401-8644-faa4b340e502', '1918c629-71f5-4877-8850-fa35f93df4a9', '89cef12e-113a-418f-8947-759b18fdedbe'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-cd7df9b5-90f2-4d3b-8750-8dc48097d64c tempest-VolumesListAdminTestJSON-1896673150 None] Acquiring lock "cinder-6ccf8438-c5e7-4e45-8662-2797b3797f7a-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-cd7df9b5-90f2-4d3b-8750-8dc48097d64c tempest-VolumesListAdminTestJSON-1896673150 None] Lock "cinder-6ccf8438-c5e7-4e45-8662-2797b3797f7a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-cd7df9b5-90f2-4d3b-8750-8dc48097d64c tempest-VolumesListAdminTestJSON-1896673150 None] Acquiring lock "cinder-quobyte-6ccf8438-c5e7-4e45-8662-2797b3797f7a" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-cd7df9b5-90f2-4d3b-8750-8dc48097d64c tempest-VolumesListAdminTestJSON-1896673150 None] Lock "cinder-quobyte-6ccf8438-c5e7-4e45-8662-2797b3797f7a" acquired by "delete_volume" :: waited 0.021s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e98b5a1a-49f4-4767-aeb9-c12b0313e681 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e98b5a1a-49f4-4767-aeb9-c12b0313e681 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e98b5a1a-49f4-4767-aeb9-c12b0313e681 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e98b5a1a-49f4-4767-aeb9-c12b0313e681 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e98b5a1a-49f4-4767-aeb9-c12b0313e681 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e98b5a1a-49f4-4767-aeb9-c12b0313e681 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:58 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[5024ec50-3f1b-4079-9d17-b023ed993134]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-cd7df9b5-90f2-4d3b-8750-8dc48097d64c tempest-VolumesListAdminTestJSON-1896673150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6ccf8438-c5e7-4e45-8662-2797b3797f7a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:58 devstack sudo[85290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:53:58 devstack sudo[85290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e6118fae-ff96-425b-8408-adb9e0857f74 tempest-VolumesListAdminTestJSON-1994105380 None] Acquiring lock "cinder-c638f112-df01-49d3-bb3c-2e2af762c2f8-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e6118fae-ff96-425b-8408-adb9e0857f74 tempest-VolumesListAdminTestJSON-1994105380 None] Lock "cinder-c638f112-df01-49d3-bb3c-2e2af762c2f8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:58 devstack sudo[85291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6ccf8438-c5e7-4e45-8662-2797b3797f7a Apr 21 20:53:58 devstack sudo[85291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e6118fae-ff96-425b-8408-adb9e0857f74 tempest-VolumesListAdminTestJSON-1994105380 None] Acquiring lock "cinder-quobyte-c638f112-df01-49d3-bb3c-2e2af762c2f8" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e6118fae-ff96-425b-8408-adb9e0857f74 tempest-VolumesListAdminTestJSON-1994105380 None] Lock "cinder-quobyte-c638f112-df01-49d3-bb3c-2e2af762c2f8" acquired by "delete_volume" :: waited 0.016s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:58 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecee549-41b9-4b97-82fc-5ae13bc19804]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e6118fae-ff96-425b-8408-adb9e0857f74 tempest-VolumesListAdminTestJSON-1994105380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c638f112-df01-49d3-bb3c-2e2af762c2f8 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:58 devstack sudo[85295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c638f112-df01-49d3-bb3c-2e2af762c2f8 Apr 21 20:53:58 devstack sudo[85295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:58 devstack sudo[85290]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e98b5a1a-49f4-4767-aeb9-c12b0313e681 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.686s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:58 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-e98b5a1a-49f4-4767-aeb9-c12b0313e681 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:58 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-e98b5a1a-49f4-4767-aeb9-c12b0313e681 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Deleted volume successfully. Apr 21 20:53:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e98b5a1a-49f4-4767-aeb9-c12b0313e681 tempest-VolumeSnapshotQuotasNegativeTestJSON-1046833763 None] Lock "cinder-d70f099f-d083-48c8-aeeb-8dafd646fa30-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:58 devstack sudo[85291]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-cd7df9b5-90f2-4d3b-8750-8dc48097d64c tempest-VolumesListAdminTestJSON-1896673150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6ccf8438-c5e7-4e45-8662-2797b3797f7a" returned: 0 in 0.862s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-cd7df9b5-90f2-4d3b-8750-8dc48097d64c tempest-VolumesListAdminTestJSON-1896673150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6ccf8438-c5e7-4e45-8662-2797b3797f7a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:59 devstack sudo[85305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6ccf8438-c5e7-4e45-8662-2797b3797f7a Apr 21 20:53:59 devstack sudo[85305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:59 devstack sudo[85295]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e6118fae-ff96-425b-8408-adb9e0857f74 tempest-VolumesListAdminTestJSON-1994105380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c638f112-df01-49d3-bb3c-2e2af762c2f8" returned: 0 in 0.750s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e6118fae-ff96-425b-8408-adb9e0857f74 tempest-VolumesListAdminTestJSON-1994105380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c638f112-df01-49d3-bb3c-2e2af762c2f8 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:59 devstack sudo[85307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c638f112-df01-49d3-bb3c-2e2af762c2f8 Apr 21 20:53:59 devstack sudo[85307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:59 devstack sudo[85305]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-cd7df9b5-90f2-4d3b-8750-8dc48097d64c tempest-VolumesListAdminTestJSON-1896673150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6ccf8438-c5e7-4e45-8662-2797b3797f7a" returned: 0 in 0.891s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-cd7df9b5-90f2-4d3b-8750-8dc48097d64c tempest-VolumesListAdminTestJSON-1896673150 None] Lock "cinder-quobyte-6ccf8438-c5e7-4e45-8662-2797b3797f7a" released by "delete_volume" :: held 1.802s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Flow 'volume_create_manager' (06c8b35b-5a4f-4d7d-b6cf-db31dab5705d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab18b476-0610-4c8b-b663-9afa79cd6963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:59 devstack sudo[85307]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab18b476-0610-4c8b-b663-9afa79cd6963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-309053427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b9b6af-1606-4d36-833e-93634ce210b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6978c3d8e04ac7b37cbc59f62ce827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:00Z,use_quota=True,user_id='f43d8575d01846859d2d5a43fdf7ca44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea3c19b-ddc5-4f3c-bb5c-f3913d09f291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea3c19b-ddc5-4f3c-bb5c-f3913d09f291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b3a6b4f-7c4a-4f07-9e2e-495cdff25824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b3a6b4f-7c4a-4f07-9e2e-495cdff25824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83b9b6af-1606-4d36-833e-93634ce210b5', 'volume_name': 'volume-83b9b6af-1606-4d36-833e-93634ce210b5', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5edaaf97-47a8-4cf9-a08e-e50280a7241d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5edaaf97-47a8-4cf9-a08e-e50280a7241d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce4ed7b0-26cb-4081-bddd-486713471ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:59 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Volume 83b9b6af-1606-4d36-833e-93634ce210b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83b9b6af-1606-4d36-833e-93634ce210b5', 'volume_size': 1} Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-309053427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b9b6af-1606-4d36-833e-93634ce210b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6978c3d8e04ac7b37cbc59f62ce827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:00Z,use_quota=True,user_id='f43d8575d01846859d2d5a43fdf7ca44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Creating volume 83b9b6af-1606-4d36-833e-93634ce210b5 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:59 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:53:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-83b9b6af-1606-4d36-833e-93634ce210b5 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:00 devstack sudo[85311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-83b9b6af-1606-4d36-833e-93634ce210b5 1073741824 Apr 21 20:54:00 devstack sudo[85311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e6118fae-ff96-425b-8408-adb9e0857f74 tempest-VolumesListAdminTestJSON-1994105380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c638f112-df01-49d3-bb3c-2e2af762c2f8" returned: 0 in 0.936s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:00 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e6118fae-ff96-425b-8408-adb9e0857f74 tempest-VolumesListAdminTestJSON-1994105380 None] Lock "cinder-quobyte-c638f112-df01-49d3-bb3c-2e2af762c2f8" released by "delete_volume" :: held 1.728s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:00 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-cd7df9b5-90f2-4d3b-8750-8dc48097d64c tempest-VolumesListAdminTestJSON-1896673150 None] Created reservations ['6531e1d9-8f98-4819-98d8-459ce111cf28', '686581cd-91ca-4970-817f-6265d45c3741', 'a9a1d25a-832b-4ecb-ace3-69a544a556ec', '203b1aa3-0706-4569-9c10-f2b536da7eb0'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:00 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-e6118fae-ff96-425b-8408-adb9e0857f74 tempest-VolumesListAdminTestJSON-1994105380 None] Created reservations ['48c6c9c9-12b0-487d-a53f-ec1d98fa13c9', '1b3a506f-2e7d-4787-8617-209283d2ffa9', '7d6f5ab0-b5ba-4d7c-baaa-bc8d0dc91ddd', '71bae1db-1573-4fd5-b1b3-9244733c496c'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-cd7df9b5-90f2-4d3b-8750-8dc48097d64c tempest-VolumesListAdminTestJSON-1896673150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-cd7df9b5-90f2-4d3b-8750-8dc48097d64c tempest-VolumesListAdminTestJSON-1896673150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-cd7df9b5-90f2-4d3b-8750-8dc48097d64c tempest-VolumesListAdminTestJSON-1896673150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-cd7df9b5-90f2-4d3b-8750-8dc48097d64c tempest-VolumesListAdminTestJSON-1896673150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-cd7df9b5-90f2-4d3b-8750-8dc48097d64c tempest-VolumesListAdminTestJSON-1896673150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-cd7df9b5-90f2-4d3b-8750-8dc48097d64c tempest-VolumesListAdminTestJSON-1896673150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e6118fae-ff96-425b-8408-adb9e0857f74 tempest-VolumesListAdminTestJSON-1994105380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e6118fae-ff96-425b-8408-adb9e0857f74 tempest-VolumesListAdminTestJSON-1994105380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e6118fae-ff96-425b-8408-adb9e0857f74 tempest-VolumesListAdminTestJSON-1994105380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:00 devstack sudo[85313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:54:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e6118fae-ff96-425b-8408-adb9e0857f74 tempest-VolumesListAdminTestJSON-1994105380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e6118fae-ff96-425b-8408-adb9e0857f74 tempest-VolumesListAdminTestJSON-1994105380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e6118fae-ff96-425b-8408-adb9e0857f74 tempest-VolumesListAdminTestJSON-1994105380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:00 devstack sudo[85313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:00 devstack sudo[85314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:54:00 devstack sudo[85314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:00 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-07879aaf-03ca-4ca5-bb29-6e66547fb69e tempest-VolumesListAdminTestJSON-1994105380 None] Acquiring lock "cinder-af53a9d3-6e7e-422d-b2e8-5f345f60d26b-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:00 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-07879aaf-03ca-4ca5-bb29-6e66547fb69e tempest-VolumesListAdminTestJSON-1994105380 None] Lock "cinder-af53a9d3-6e7e-422d-b2e8-5f345f60d26b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:00 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-07879aaf-03ca-4ca5-bb29-6e66547fb69e tempest-VolumesListAdminTestJSON-1994105380 None] Acquiring lock "cinder-quobyte-af53a9d3-6e7e-422d-b2e8-5f345f60d26b" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:00 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-07879aaf-03ca-4ca5-bb29-6e66547fb69e tempest-VolumesListAdminTestJSON-1994105380 None] Lock "cinder-quobyte-af53a9d3-6e7e-422d-b2e8-5f345f60d26b" acquired by "delete_volume" :: waited 0.025s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:00 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62714f9-6774-4d20-b707-e0a37c8f623c]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-07879aaf-03ca-4ca5-bb29-6e66547fb69e tempest-VolumesListAdminTestJSON-1994105380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-af53a9d3-6e7e-422d-b2e8-5f345f60d26b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:01 devstack sudo[85332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-af53a9d3-6e7e-422d-b2e8-5f345f60d26b Apr 21 20:54:01 devstack sudo[85332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:01 devstack sudo[85314]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e6118fae-ff96-425b-8408-adb9e0857f74 tempest-VolumesListAdminTestJSON-1994105380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.854s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:01 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-e6118fae-ff96-425b-8408-adb9e0857f74 tempest-VolumesListAdminTestJSON-1994105380 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:01 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-e6118fae-ff96-425b-8408-adb9e0857f74 tempest-VolumesListAdminTestJSON-1994105380 None] Deleted volume successfully. Apr 21 20:54:01 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e6118fae-ff96-425b-8408-adb9e0857f74 tempest-VolumesListAdminTestJSON-1994105380 None] Lock "cinder-c638f112-df01-49d3-bb3c-2e2af762c2f8-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:01 devstack sudo[85313]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-cd7df9b5-90f2-4d3b-8750-8dc48097d64c tempest-VolumesListAdminTestJSON-1896673150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.989s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:01 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-cd7df9b5-90f2-4d3b-8750-8dc48097d64c tempest-VolumesListAdminTestJSON-1896673150 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:01 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-cd7df9b5-90f2-4d3b-8750-8dc48097d64c tempest-VolumesListAdminTestJSON-1896673150 None] Deleted volume successfully. Apr 21 20:54:01 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-cd7df9b5-90f2-4d3b-8750-8dc48097d64c tempest-VolumesListAdminTestJSON-1896673150 None] Lock "cinder-6ccf8438-c5e7-4e45-8662-2797b3797f7a-delete_volume" released by "delete_volume" :: held 3.111s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:01 devstack sudo[85311]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-83b9b6af-1606-4d36-833e-93634ce210b5 1073741824" returned: 0 in 1.163s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-83b9b6af-1606-4d36-833e-93634ce210b5 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:01 devstack sudo[85348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-83b9b6af-1606-4d36-833e-93634ce210b5 Apr 21 20:54:01 devstack sudo[85348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:01 devstack sudo[85332]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-07879aaf-03ca-4ca5-bb29-6e66547fb69e tempest-VolumesListAdminTestJSON-1994105380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-af53a9d3-6e7e-422d-b2e8-5f345f60d26b" returned: 0 in 0.844s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-07879aaf-03ca-4ca5-bb29-6e66547fb69e tempest-VolumesListAdminTestJSON-1994105380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-af53a9d3-6e7e-422d-b2e8-5f345f60d26b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:01 devstack sudo[85354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-af53a9d3-6e7e-422d-b2e8-5f345f60d26b Apr 21 20:54:01 devstack sudo[85354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:01 devstack sudo[85348]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-83b9b6af-1606-4d36-833e-93634ce210b5" returned: 0 in 0.493s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce4ed7b0-26cb-4081-bddd-486713471ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83b9b6af-1606-4d36-833e-93634ce210b5', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35802095-f4f8-42ff-a311-504705b7fd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:01 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Volume volume-83b9b6af-1606-4d36-833e-93634ce210b5 (83b9b6af-1606-4d36-833e-93634ce210b5): created successfully Apr 21 20:54:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35802095-f4f8-42ff-a311-504705b7fd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Flow 'volume_create_manager' (06c8b35b-5a4f-4d7d-b6cf-db31dab5705d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:01 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-2876cbb7-7ab4-4ec1-8d81-28422dcd0bd0 tempest-AbsoluteLimitsTests-620343692 None] Created volume successfully. Apr 21 20:54:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-efead752-2042-4288-8200-fb0f6f198c6d tempest-AbsoluteLimitsTests-620343692 None] Acquiring lock "cinder-83b9b6af-1606-4d36-833e-93634ce210b5-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-efead752-2042-4288-8200-fb0f6f198c6d tempest-AbsoluteLimitsTests-620343692 None] Lock "cinder-83b9b6af-1606-4d36-833e-93634ce210b5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-efead752-2042-4288-8200-fb0f6f198c6d tempest-AbsoluteLimitsTests-620343692 None] Acquiring lock "cinder-quobyte-83b9b6af-1606-4d36-833e-93634ce210b5" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-efead752-2042-4288-8200-fb0f6f198c6d tempest-AbsoluteLimitsTests-620343692 None] Lock "cinder-quobyte-83b9b6af-1606-4d36-833e-93634ce210b5" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:02 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27d2fb7-8754-4c41-bc1a-f4d9512a712c]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-efead752-2042-4288-8200-fb0f6f198c6d tempest-AbsoluteLimitsTests-620343692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-83b9b6af-1606-4d36-833e-93634ce210b5 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:02 devstack sudo[85354]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-07879aaf-03ca-4ca5-bb29-6e66547fb69e tempest-VolumesListAdminTestJSON-1994105380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-af53a9d3-6e7e-422d-b2e8-5f345f60d26b" returned: 0 in 0.667s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-07879aaf-03ca-4ca5-bb29-6e66547fb69e tempest-VolumesListAdminTestJSON-1994105380 None] Lock "cinder-quobyte-af53a9d3-6e7e-422d-b2e8-5f345f60d26b" released by "delete_volume" :: held 1.576s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:02 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-07879aaf-03ca-4ca5-bb29-6e66547fb69e tempest-VolumesListAdminTestJSON-1994105380 None] Created reservations ['84fb3347-41d6-4738-a187-83fc3fd9acc6', '6d9b7a68-b149-44f6-bfbf-c89466c678aa', 'bd30baa0-99b0-4fdd-b015-6204e136a8d9', '42b29970-106e-43c8-b264-9ff279face98'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-07879aaf-03ca-4ca5-bb29-6e66547fb69e tempest-VolumesListAdminTestJSON-1994105380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-07879aaf-03ca-4ca5-bb29-6e66547fb69e tempest-VolumesListAdminTestJSON-1994105380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:02 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-07879aaf-03ca-4ca5-bb29-6e66547fb69e tempest-VolumesListAdminTestJSON-1994105380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:02 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-07879aaf-03ca-4ca5-bb29-6e66547fb69e tempest-VolumesListAdminTestJSON-1994105380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-07879aaf-03ca-4ca5-bb29-6e66547fb69e tempest-VolumesListAdminTestJSON-1994105380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-07879aaf-03ca-4ca5-bb29-6e66547fb69e tempest-VolumesListAdminTestJSON-1994105380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:02 devstack sudo[85358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:54:02 devstack sudo[85358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:02 devstack sudo[85357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-83b9b6af-1606-4d36-833e-93634ce210b5 Apr 21 20:54:02 devstack sudo[85357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:02 devstack sudo[85358]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-07879aaf-03ca-4ca5-bb29-6e66547fb69e tempest-VolumesListAdminTestJSON-1994105380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.517s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:02 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-07879aaf-03ca-4ca5-bb29-6e66547fb69e tempest-VolumesListAdminTestJSON-1994105380 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:02 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-07879aaf-03ca-4ca5-bb29-6e66547fb69e tempest-VolumesListAdminTestJSON-1994105380 None] Deleted volume successfully. Apr 21 20:54:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-07879aaf-03ca-4ca5-bb29-6e66547fb69e tempest-VolumesListAdminTestJSON-1994105380 None] Lock "cinder-af53a9d3-6e7e-422d-b2e8-5f345f60d26b-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e47b71fe-5a60-487a-ae06-177e809fe96d tempest-VolumesListAdminTestJSON-1994105380 None] Acquiring lock "cinder-e43646e3-1144-4f9c-bd29-610c49fbd7cd-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e47b71fe-5a60-487a-ae06-177e809fe96d tempest-VolumesListAdminTestJSON-1994105380 None] Lock "cinder-e43646e3-1144-4f9c-bd29-610c49fbd7cd-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e47b71fe-5a60-487a-ae06-177e809fe96d tempest-VolumesListAdminTestJSON-1994105380 None] Acquiring lock "cinder-quobyte-e43646e3-1144-4f9c-bd29-610c49fbd7cd" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e47b71fe-5a60-487a-ae06-177e809fe96d tempest-VolumesListAdminTestJSON-1994105380 None] Lock "cinder-quobyte-e43646e3-1144-4f9c-bd29-610c49fbd7cd" acquired by "delete_volume" :: waited 0.025s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:03 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[700762a6-ddd6-422c-a4b8-9053589fb492]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e47b71fe-5a60-487a-ae06-177e809fe96d tempest-VolumesListAdminTestJSON-1994105380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e43646e3-1144-4f9c-bd29-610c49fbd7cd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:03 devstack sudo[85357]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-efead752-2042-4288-8200-fb0f6f198c6d tempest-AbsoluteLimitsTests-620343692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-83b9b6af-1606-4d36-833e-93634ce210b5" returned: 0 in 0.889s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-efead752-2042-4288-8200-fb0f6f198c6d tempest-AbsoluteLimitsTests-620343692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-83b9b6af-1606-4d36-833e-93634ce210b5 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:03 devstack sudo[85366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-83b9b6af-1606-4d36-833e-93634ce210b5 Apr 21 20:54:03 devstack sudo[85366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:03 devstack sudo[85365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e43646e3-1144-4f9c-bd29-610c49fbd7cd Apr 21 20:54:03 devstack sudo[85365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:03 devstack sudo[85366]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-efead752-2042-4288-8200-fb0f6f198c6d tempest-AbsoluteLimitsTests-620343692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-83b9b6af-1606-4d36-833e-93634ce210b5" returned: 0 in 0.665s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-efead752-2042-4288-8200-fb0f6f198c6d tempest-AbsoluteLimitsTests-620343692 None] Lock "cinder-quobyte-83b9b6af-1606-4d36-833e-93634ce210b5" released by "delete_volume" :: held 1.616s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:03 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-efead752-2042-4288-8200-fb0f6f198c6d tempest-AbsoluteLimitsTests-620343692 None] Created reservations ['1b6101b1-284d-4420-83de-dd4994bccb9b', 'ad9a530d-4054-4d0b-b81e-3bb54f3b68c6', '26adf6c7-d1dc-4674-bc6e-d54ffd33c85d', '73ca62f5-a81a-43a1-9b66-d7950104c1c5'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:03 devstack sudo[85365]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e47b71fe-5a60-487a-ae06-177e809fe96d tempest-VolumesListAdminTestJSON-1994105380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e43646e3-1144-4f9c-bd29-610c49fbd7cd" returned: 0 in 0.833s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e47b71fe-5a60-487a-ae06-177e809fe96d tempest-VolumesListAdminTestJSON-1994105380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e43646e3-1144-4f9c-bd29-610c49fbd7cd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-efead752-2042-4288-8200-fb0f6f198c6d tempest-AbsoluteLimitsTests-620343692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-efead752-2042-4288-8200-fb0f6f198c6d tempest-AbsoluteLimitsTests-620343692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-efead752-2042-4288-8200-fb0f6f198c6d tempest-AbsoluteLimitsTests-620343692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-efead752-2042-4288-8200-fb0f6f198c6d tempest-AbsoluteLimitsTests-620343692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-efead752-2042-4288-8200-fb0f6f198c6d tempest-AbsoluteLimitsTests-620343692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-efead752-2042-4288-8200-fb0f6f198c6d tempest-AbsoluteLimitsTests-620343692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:03 devstack sudo[85373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e43646e3-1144-4f9c-bd29-610c49fbd7cd Apr 21 20:54:03 devstack sudo[85373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:03 devstack sudo[85375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:54:03 devstack sudo[85375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Flow 'volume_create_manager' (c85378c0-33d1-46aa-9e04-7c8d1ed62969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b9852f-032d-469c-97aa-6f1c8a0025fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b9852f-032d-469c-97aa-6f1c8a0025fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1018896778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6d44c8-ff4a-4366-85df-72e92123eb50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb9217b62284b4993bb070f74b53303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:04Z,use_quota=True,user_id='95b166dc6f6b41569d8bf0010be76f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6a6d546-63e0-430a-a3cd-85991fc5f7a2),volume_type_id=c6a6d546-63e0-430a-a3cd-85991fc5f7a2)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88c7774-76d7-4e05-a939-e8ab90db57e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88c7774-76d7-4e05-a939-e8ab90db57e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151624a6-3c95-4dda-98fb-9ff2f60f5d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151624a6-3c95-4dda-98fb-9ff2f60f5d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b6d44c8-ff4a-4366-85df-72e92123eb50', 'volume_name': 'volume-0b6d44c8-ff4a-4366-85df-72e92123eb50', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff1128e-2c44-4764-b354-803144ff79e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:04 devstack sudo[85375]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff1128e-2c44-4764-b354-803144ff79e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae6c72e-72fc-4611-b1ee-cbc55137e4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:04 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Volume 0b6d44c8-ff4a-4366-85df-72e92123eb50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b6d44c8-ff4a-4366-85df-72e92123eb50', 'volume_size': 1} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1018896778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6d44c8-ff4a-4366-85df-72e92123eb50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb9217b62284b4993bb070f74b53303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:04Z,use_quota=True,user_id='95b166dc6f6b41569d8bf0010be76f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6a6d546-63e0-430a-a3cd-85991fc5f7a2),volume_type_id=c6a6d546-63e0-430a-a3cd-85991fc5f7a2)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Creating volume 0b6d44c8-ff4a-4366-85df-72e92123eb50 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:04 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b6d44c8-ff4a-4366-85df-72e92123eb50 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:04 devstack sudo[85373]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-efead752-2042-4288-8200-fb0f6f198c6d tempest-AbsoluteLimitsTests-620343692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.663s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-efead752-2042-4288-8200-fb0f6f198c6d tempest-AbsoluteLimitsTests-620343692 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e47b71fe-5a60-487a-ae06-177e809fe96d tempest-VolumesListAdminTestJSON-1994105380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e43646e3-1144-4f9c-bd29-610c49fbd7cd" returned: 0 in 0.711s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:04 devstack sudo[85379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b6d44c8-ff4a-4366-85df-72e92123eb50 1073741824 Apr 21 20:54:04 devstack sudo[85379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:04 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-efead752-2042-4288-8200-fb0f6f198c6d tempest-AbsoluteLimitsTests-620343692 None] Deleted volume successfully. Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e47b71fe-5a60-487a-ae06-177e809fe96d tempest-VolumesListAdminTestJSON-1994105380 None] Lock "cinder-quobyte-e43646e3-1144-4f9c-bd29-610c49fbd7cd" released by "delete_volume" :: held 1.614s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-efead752-2042-4288-8200-fb0f6f198c6d tempest-AbsoluteLimitsTests-620343692 None] Lock "cinder-83b9b6af-1606-4d36-833e-93634ce210b5-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-e47b71fe-5a60-487a-ae06-177e809fe96d tempest-VolumesListAdminTestJSON-1994105380 None] Created reservations ['42167aff-5618-497e-af02-dac6a7afabc8', '9c0518e1-6ab0-4051-b190-6e13aa52c908', '98e8dd93-534b-4c66-bfb6-7101d6ba9903', '9f058120-9fb0-4b30-a640-a0fe6b625081'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e47b71fe-5a60-487a-ae06-177e809fe96d tempest-VolumesListAdminTestJSON-1994105380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e47b71fe-5a60-487a-ae06-177e809fe96d tempest-VolumesListAdminTestJSON-1994105380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e47b71fe-5a60-487a-ae06-177e809fe96d tempest-VolumesListAdminTestJSON-1994105380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e47b71fe-5a60-487a-ae06-177e809fe96d tempest-VolumesListAdminTestJSON-1994105380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e47b71fe-5a60-487a-ae06-177e809fe96d tempest-VolumesListAdminTestJSON-1994105380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e47b71fe-5a60-487a-ae06-177e809fe96d tempest-VolumesListAdminTestJSON-1994105380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:04 devstack sudo[85381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:54:04 devstack sudo[85381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:05 devstack sudo[85379]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b6d44c8-ff4a-4366-85df-72e92123eb50 1073741824" returned: 0 in 1.000s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b6d44c8-ff4a-4366-85df-72e92123eb50 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:05 devstack sudo[85387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b6d44c8-ff4a-4366-85df-72e92123eb50 Apr 21 20:54:05 devstack sudo[85387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:05 devstack sudo[85381]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e47b71fe-5a60-487a-ae06-177e809fe96d tempest-VolumesListAdminTestJSON-1994105380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.913s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:05 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-e47b71fe-5a60-487a-ae06-177e809fe96d tempest-VolumesListAdminTestJSON-1994105380 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:05 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-e47b71fe-5a60-487a-ae06-177e809fe96d tempest-VolumesListAdminTestJSON-1994105380 None] Deleted volume successfully. Apr 21 20:54:05 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e47b71fe-5a60-487a-ae06-177e809fe96d tempest-VolumesListAdminTestJSON-1994105380 None] Lock "cinder-e43646e3-1144-4f9c-bd29-610c49fbd7cd-delete_volume" released by "delete_volume" :: held 2.767s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:06 devstack sudo[85387]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b6d44c8-ff4a-4366-85df-72e92123eb50" returned: 0 in 0.708s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae6c72e-72fc-4611-b1ee-cbc55137e4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b6d44c8-ff4a-4366-85df-72e92123eb50', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a2e358-733c-43d5-acb0-79630735d7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:06 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Volume volume-0b6d44c8-ff4a-4366-85df-72e92123eb50 (0b6d44c8-ff4a-4366-85df-72e92123eb50): created successfully Apr 21 20:54:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a2e358-733c-43d5-acb0-79630735d7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Flow 'volume_create_manager' (c85378c0-33d1-46aa-9e04-7c8d1ed62969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:06 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-6c0d0f8b-a07f-4a29-b57b-3593a53f86ea tempest-VolumeTypesAccessTest-1003883115 None] Created volume successfully. Apr 21 20:54:06 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a0a92db8-e5b8-4069-b30d-fbb19645584a tempest-VolumeTypesAccessTest-1003883115 None] Acquiring lock "cinder-0b6d44c8-ff4a-4366-85df-72e92123eb50-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:06 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a0a92db8-e5b8-4069-b30d-fbb19645584a tempest-VolumeTypesAccessTest-1003883115 None] Lock "cinder-0b6d44c8-ff4a-4366-85df-72e92123eb50-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:06 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a0a92db8-e5b8-4069-b30d-fbb19645584a tempest-VolumeTypesAccessTest-1003883115 None] Acquiring lock "cinder-quobyte-0b6d44c8-ff4a-4366-85df-72e92123eb50" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:06 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a0a92db8-e5b8-4069-b30d-fbb19645584a tempest-VolumeTypesAccessTest-1003883115 None] Lock "cinder-quobyte-0b6d44c8-ff4a-4366-85df-72e92123eb50" acquired by "delete_volume" :: waited 0.013s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:06 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[77912fe3-beb9-4b16-b412-84f66088f1b8]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a0a92db8-e5b8-4069-b30d-fbb19645584a tempest-VolumeTypesAccessTest-1003883115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b6d44c8-ff4a-4366-85df-72e92123eb50 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:07 devstack sudo[85396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b6d44c8-ff4a-4366-85df-72e92123eb50 Apr 21 20:54:07 devstack sudo[85396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:07 devstack sudo[85396]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a0a92db8-e5b8-4069-b30d-fbb19645584a tempest-VolumeTypesAccessTest-1003883115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b6d44c8-ff4a-4366-85df-72e92123eb50" returned: 0 in 0.735s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a0a92db8-e5b8-4069-b30d-fbb19645584a tempest-VolumeTypesAccessTest-1003883115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b6d44c8-ff4a-4366-85df-72e92123eb50 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:07 devstack sudo[85402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b6d44c8-ff4a-4366-85df-72e92123eb50 Apr 21 20:54:07 devstack sudo[85402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Flow 'volume_create_manager' (7cb7fec4-3d59-4a0c-84dc-67b558e0350a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9ec73ef-0128-4fd9-9fc9-6f13a39f02ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9ec73ef-0128-4fd9-9fc9-6f13a39f02ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1584357293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256561c7-1bbe-4a88-a80f-05d5ee9f4f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a67d0f6337040c486db592b492a5610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:08Z,use_quota=True,user_id='c992c28659674ca08588f1f7bd2d2611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc6e570-9042-4579-950e-b7f2f1af6152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc6e570-9042-4579-950e-b7f2f1af6152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678667d0-4482-403f-b617-4095f8e4da4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678667d0-4482-403f-b617-4095f8e4da4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '256561c7-1bbe-4a88-a80f-05d5ee9f4f42', 'volume_name': 'volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d40317-e0e4-4023-95ea-041f15eade3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d40317-e0e4-4023-95ea-041f15eade3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a97988-4356-4a7e-8bca-57cfb1f58459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:08 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Volume 256561c7-1bbe-4a88-a80f-05d5ee9f4f42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42', 'volume_size': 1} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1584357293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256561c7-1bbe-4a88-a80f-05d5ee9f4f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a67d0f6337040c486db592b492a5610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:08Z,use_quota=True,user_id='c992c28659674ca08588f1f7bd2d2611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Creating volume 256561c7-1bbe-4a88-a80f-05d5ee9f4f42 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:08 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:08 devstack sudo[85405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42 1073741824 Apr 21 20:54:08 devstack sudo[85405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:08 devstack sudo[85402]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a0a92db8-e5b8-4069-b30d-fbb19645584a tempest-VolumeTypesAccessTest-1003883115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b6d44c8-ff4a-4366-85df-72e92123eb50" returned: 0 in 0.579s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a0a92db8-e5b8-4069-b30d-fbb19645584a tempest-VolumeTypesAccessTest-1003883115 None] Lock "cinder-quobyte-0b6d44c8-ff4a-4366-85df-72e92123eb50" released by "delete_volume" :: held 1.350s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:08 devstack cinder-volume[81957]: WARNING cinder.quota [None req-a0a92db8-e5b8-4069-b30d-fbb19645584a tempest-VolumeTypesAccessTest-1003883115 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1238615099 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1238615099, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:54:08 devstack cinder-volume[81957]: WARNING cinder.quota [None req-a0a92db8-e5b8-4069-b30d-fbb19645584a tempest-VolumeTypesAccessTest-1003883115 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1238615099 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1238615099, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-a0a92db8-e5b8-4069-b30d-fbb19645584a tempest-VolumeTypesAccessTest-1003883115 None] Created reservations ['f396d36c-b623-4323-84df-bf9b8ce86f22', '8d3bd490-31d4-4dab-aed3-ea71d9a3423c', '1537f858-4613-4bf7-b43b-f68c8f1ee2d8', '70d26b1c-8c9d-4a1c-815c-ef1a2c755aa8'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a0a92db8-e5b8-4069-b30d-fbb19645584a tempest-VolumeTypesAccessTest-1003883115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a0a92db8-e5b8-4069-b30d-fbb19645584a tempest-VolumeTypesAccessTest-1003883115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a0a92db8-e5b8-4069-b30d-fbb19645584a tempest-VolumeTypesAccessTest-1003883115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a0a92db8-e5b8-4069-b30d-fbb19645584a tempest-VolumeTypesAccessTest-1003883115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a0a92db8-e5b8-4069-b30d-fbb19645584a tempest-VolumeTypesAccessTest-1003883115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a0a92db8-e5b8-4069-b30d-fbb19645584a tempest-VolumeTypesAccessTest-1003883115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:08 devstack sudo[85407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:54:08 devstack sudo[85407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:08 devstack sudo[85405]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42 1073741824" returned: 0 in 0.646s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:08 devstack sudo[85413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42 Apr 21 20:54:08 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:09 devstack sudo[85407]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a0a92db8-e5b8-4069-b30d-fbb19645584a tempest-VolumeTypesAccessTest-1003883115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.852s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:09 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-a0a92db8-e5b8-4069-b30d-fbb19645584a tempest-VolumeTypesAccessTest-1003883115 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:09 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-a0a92db8-e5b8-4069-b30d-fbb19645584a tempest-VolumeTypesAccessTest-1003883115 None] Deleted volume successfully. Apr 21 20:54:09 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a0a92db8-e5b8-4069-b30d-fbb19645584a tempest-VolumeTypesAccessTest-1003883115 None] Lock "cinder-0b6d44c8-ff4a-4366-85df-72e92123eb50-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:09 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42" returned: 0 in 0.567s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:09 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a97988-4356-4a7e-8bca-57cfb1f58459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d004eac9-057f-40ac-a355-0e457ea4d9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:09 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Volume volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42 (256561c7-1bbe-4a88-a80f-05d5ee9f4f42): created successfully Apr 21 20:54:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d004eac9-057f-40ac-a355-0e457ea4d9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Flow 'volume_create_manager' (7cb7fec4-3d59-4a0c-84dc-67b558e0350a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:09 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-183d4275-367f-4201-9db9-c7df5a10861c tempest-VolumesDeleteCascade-1413170871 None] Created volume successfully. Apr 21 20:54:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-21947951-4041-422a-9fa9-68e38f80514b tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-21947951-4041-422a-9fa9-68e38f80514b tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-21947951-4041-422a-9fa9-68e38f80514b tempest-VolumesDeleteCascade-1413170871 None] Creating offline snapshot beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 of volume 256561c7-1bbe-4a88-a80f-05d5ee9f4f42 {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:54:10 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fbbc4f-789a-4531-be07-b5f5cfa70cf0]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-21947951-4041-422a-9fa9-68e38f80514b tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:10 devstack sudo[85417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42 Apr 21 20:54:10 devstack sudo[85417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:11 devstack sudo[85417]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-21947951-4041-422a-9fa9-68e38f80514b tempest-VolumesDeleteCascade-1413170871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42" returned: 0 in 0.815s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-21947951-4041-422a-9fa9-68e38f80514b tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:11 devstack sudo[85423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 1G Apr 21 20:54:11 devstack sudo[85423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:12 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Flow 'volume_create_manager' (9d4c8d80-012e-47f6-bfce-4647b0d7bcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e516273-1b55-44dd-a516-fadaa88ad6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e516273-1b55-44dd-a516-fadaa88ad6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1370479356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a577e9ff-3dde-44d5-b180-6c7d91bce8e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d908e3cb28174210bfee6dcd4cc0e7d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:12Z,use_quota=True,user_id='ccbbd6323cee4881ac9b7de565d60446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da73119d-2984-48df-b7e0-3e1894923497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da73119d-2984-48df-b7e0-3e1894923497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654828b6-cd86-478e-8571-d5a5b102dd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:12 devstack cinder-volume[81957]: DEBUG cinder.image.glance [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Creating Keystone auth plugin from conf {{(pid=81957) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 21 20:54:12 devstack sudo[85423]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-21947951-4041-422a-9fa9-68e38f80514b tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 1G" returned: 0 in 1.122s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-21947951-4041-422a-9fa9-68e38f80514b tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:12 devstack sudo[85428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 Apr 21 20:54:12 devstack sudo[85428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:12 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Flow 'volume_create_manager' (33916a51-5dbc-4e83-8f2c-5c6c67f06619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc2ab8a-5674-4ae5-812b-8f59389a5fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc2ab8a-5674-4ae5-812b-8f59389a5fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:12Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f66f3b-e7da-404b-949d-6a317e298a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a255d011c2824b3bae82d33c2538b84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:13Z,use_quota=True,user_id='1e38afaf8abb4513be76f05aba60a3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5169ed5e-c7cf-4199-8ca9-9e5a8d6ed595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5169ed5e-c7cf-4199-8ca9-9e5a8d6ed595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f763fa1-5106-4439-8dbb-a93c642133de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:12 devstack cinder-volume[81957]: DEBUG cinder.image.glance [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Creating Keystone auth plugin from conf {{(pid=81957) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 21 20:54:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f763fa1-5106-4439-8dbb-a93c642133de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '66f66f3b-e7da-404b-949d-6a317e298a52', 'volume_name': 'volume-66f66f3b-e7da-404b-949d-6a317e298a52', 'volume_size': 1, 'image_id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea9a1f20637b41ec8f283a778363aed0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c112cf7-9f7d-490e-8e52-abb08838bafa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b289e219-6931-439d-8cdd-a74fa444d949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b289e219-6931-439d-8cdd-a74fa444d949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a568a7-554c-4824-9bec-81a3c525b14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:13 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Volume 66f66f3b-e7da-404b-949d-6a317e298a52: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-66f66f3b-e7da-404b-949d-6a317e298a52', 'volume_size': 1, 'image_id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea9a1f20637b41ec8f283a778363aed0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c112cf7-9f7d-490e-8e52-abb08838bafa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 21 20:54:13 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Trying to clone 66f66f3b-e7da-404b-949d-6a317e298a52 from image 1c112cf7-9f7d-490e-8e52-abb08838bafa at location (None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}]). {{(pid=81957) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 21 20:54:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654828b6-cd86-478e-8571-d5a5b102dd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a577e9ff-3dde-44d5-b180-6c7d91bce8e7', 'volume_name': 'volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7', 'volume_size': 1, 'image_id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea9a1f20637b41ec8f283a778363aed0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c112cf7-9f7d-490e-8e52-abb08838bafa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ddc3ded-aab1-481e-b287-b48cbc6920e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ddc3ded-aab1-481e-b287-b48cbc6920e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c51808-3e0f-4ffb-a700-00260e52f539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:13 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Volume a577e9ff-3dde-44d5-b180-6c7d91bce8e7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7', 'volume_size': 1, 'image_id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea9a1f20637b41ec8f283a778363aed0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c112cf7-9f7d-490e-8e52-abb08838bafa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 21 20:54:13 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Trying to clone a577e9ff-3dde-44d5-b180-6c7d91bce8e7 from image 1c112cf7-9f7d-490e-8e52-abb08838bafa at location (None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}]). {{(pid=81957) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 21 20:54:13 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_pk2hofv6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81957) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 21 20:54:13 devstack cinder-volume[81957]: INFO cinder.image.image_utils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Image download 20.69 MB at 20.69 MB/s Apr 21 20:54:13 devstack sudo[85428]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:13 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_eem5gwazdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81957) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 21 20:54:13 devstack cinder-volume[81957]: INFO cinder.image.image_utils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Image download 20.69 MB at 20.69 MB/s Apr 21 20:54:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-21947951-4041-422a-9fa9-68e38f80514b tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5" returned: 0 in 1.323s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:13 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-21947951-4041-422a-9fa9-68e38f80514b tempest-VolumesDeleteCascade-1413170871 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 is being set with open permissions: ugo+rw Apr 21 20:54:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-21947951-4041-422a-9fa9-68e38f80514b tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:13 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c714adf-4e8d-4aca-b279-d4de55878b71]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_pk2hofv6devstack@QuobyteHD {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:13 devstack sudo[85456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 Apr 21 20:54:13 devstack sudo[85456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:13 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[0147862e-d2d0-43ea-8b3d-bbe5ec73e50a]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_eem5gwazdevstack@QuobyteHD {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:13 devstack sudo[85460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_eem5gwazdevstack@QuobyteHD Apr 21 20:54:13 devstack sudo[85460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:13 devstack sudo[85457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_pk2hofv6devstack@QuobyteHD Apr 21 20:54:13 devstack sudo[85457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:14 devstack sudo[85456]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-21947951-4041-422a-9fa9-68e38f80514b tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5" returned: 0 in 0.540s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-21947951-4041-422a-9fa9-68e38f80514b tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:14 devstack sudo[85460]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_eem5gwazdevstack@QuobyteHD" returned: 0 in 0.571s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:14 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Temporary image 1c112cf7-9f7d-490e-8e52-abb08838bafa is fetched for user ccbbd6323cee4881ac9b7de565d60446. {{(pid=81957) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 21 20:54:14 devstack sudo[85484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.info Apr 21 20:54:14 devstack sudo[85484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:14 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e481f7f-59e5-4f29-b040-a915c739bfa5]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_eem5gwazdevstack@QuobyteHD {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:14 devstack sudo[85486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_eem5gwazdevstack@QuobyteHD Apr 21 20:54:14 devstack sudo[85486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:14 devstack sudo[85457]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_pk2hofv6devstack@QuobyteHD" returned: 0 in 1.109s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:14 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Temporary image 1c112cf7-9f7d-490e-8e52-abb08838bafa is fetched for user 1e38afaf8abb4513be76f05aba60a3b7. {{(pid=81957) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 21 20:54:14 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fadee3b-cb6e-46c5-8354-0f538d97f4b7]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_pk2hofv6devstack@QuobyteHD {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:15 devstack sudo[85484]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-21947951-4041-422a-9fa9-68e38f80514b tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.info" returned: 0 in 0.714s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:15 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-21947951-4041-422a-9fa9-68e38f80514b tempest-VolumesDeleteCascade-1413170871 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.info is being set with open permissions: ugo+rw Apr 21 20:54:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-21947951-4041-422a-9fa9-68e38f80514b tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:15 devstack sudo[85501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.info Apr 21 20:54:15 devstack sudo[85501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:15 devstack sudo[85500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_pk2hofv6devstack@QuobyteHD Apr 21 20:54:15 devstack sudo[85500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:15 devstack sudo[85486]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_eem5gwazdevstack@QuobyteHD" returned: 0 in 1.013s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:15 devstack sudo[85500]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_pk2hofv6devstack@QuobyteHD" returned: 0 in 0.647s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:15 devstack sudo[85501]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-21947951-4041-422a-9fa9-68e38f80514b tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.info" returned: 0 in 0.672s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-21947951-4041-422a-9fa9-68e38f80514b tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.281s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.289s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1370479356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a577e9ff-3dde-44d5-b180-6c7d91bce8e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d908e3cb28174210bfee6dcd4cc0e7d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:12Z,use_quota=True,user_id='ccbbd6323cee4881ac9b7de565d60446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Creating volume a577e9ff-3dde-44d5-b180-6c7d91bce8e7 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:15 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:54:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:15 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-21947951-4041-422a-9fa9-68e38f80514b tempest-VolumesDeleteCascade-1413170871 None] Create snapshot completed successfully Apr 21 20:54:15 devstack sudo[85534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7 1073741824 Apr 21 20:54:15 devstack sudo[85534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:16 devstack sudo[85534]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7 1073741824" returned: 0 in 0.711s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:16 devstack sudo[85539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7 Apr 21 20:54:16 devstack sudo[85539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f3b6a589-19c5-4dd5-baad-a5fe12e69979 tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:17 devstack sudo[85539]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7" returned: 0 in 0.535s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:17 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.437s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:17 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:12Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f66f3b-e7da-404b-949d-6a317e298a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a255d011c2824b3bae82d33c2538b84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:13Z,use_quota=True,user_id='1e38afaf8abb4513be76f05aba60a3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:17 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Creating volume 66f66f3b-e7da-404b-949d-6a317e298a52 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:17 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:17 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:17 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:17 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:54:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:17 devstack sudo[85542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 1073741824 Apr 21 20:54:17 devstack sudo[85542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:17 devstack cinder-volume[81957]: DEBUG cinder.volume.volume_utils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Attempting download of 1c112cf7-9f7d-490e-8e52-abb08838bafa ((None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}])) to volume a577e9ff-3dde-44d5-b180-6c7d91bce8e7. {{(pid=81957) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 21 20:54:17 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7aefb98-a3ed-49ac-a71b-cb64cce08b6a]: (4, 'raw') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_d7i094bp {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:17 devstack sudo[85544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_d7i094bp Apr 21 20:54:17 devstack sudo[85544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:17 devstack sudo[85542]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 1073741824" returned: 0 in 0.678s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:17 devstack sudo[85551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 Apr 21 20:54:17 devstack sudo[85551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:17 devstack sudo[85544]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_d7i094bp" returned: 0 in 0.724s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_d7i094bp {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:17 devstack sudo[85553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_d7i094bp Apr 21 20:54:17 devstack sudo[85553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:18 devstack sudo[85551]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52" returned: 0 in 0.557s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f3b6a589-19c5-4dd5-baad-a5fe12e69979 tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.349s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-f3b6a589-19c5-4dd5-baad-a5fe12e69979 tempest-VolumesDeleteCascade-1413170871 None] Creating offline snapshot 2c9a2d0b-92f7-4273-9e5f-7168fbd4c965 of volume 256561c7-1bbe-4a88-a80f-05d5ee9f4f42 {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:54:18 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9bcf2b-2ff6-4db4-b97b-7e40210a224f]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f3b6a589-19c5-4dd5-baad-a5fe12e69979 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:18 devstack sudo[85553]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_d7i094bp" returned: 1 in 0.557s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_d7i094bp' failed. Not Retrying. {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:54:18 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a52e533-3b11-4834-8792-dbc359db4483]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:18 devstack cinder-volume[81957]: DEBUG cinder.volume.volume_utils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Attempting download of 1c112cf7-9f7d-490e-8e52-abb08838bafa ((None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}])) to volume 66f66f3b-e7da-404b-949d-6a317e298a52. {{(pid=81957) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 21 20:54:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_eem5gwazdevstack@QuobyteHD {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:18 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e00d22-af65-45b5-8605-fc707dc489f7]: (4, 'raw') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_hlp8l34q {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:18 devstack sudo[85559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_eem5gwazdevstack@QuobyteHD Apr 21 20:54:18 devstack sudo[85559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:18 devstack sudo[85558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 Apr 21 20:54:18 devstack sudo[85558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:18 devstack sudo[85560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_hlp8l34q Apr 21 20:54:18 devstack sudo[85560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:19 devstack sudo[85559]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_eem5gwazdevstack@QuobyteHD" returned: 0 in 0.767s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:19 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] 1c112cf7-9f7d-490e-8e52-abb08838bafa was qcow2, converting to raw {{(pid=81957) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 21 20:54:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_eem5gwazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:19 devstack sudo[85571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_eem5gwazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7 Apr 21 20:54:19 devstack sudo[85571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:19 devstack sudo[85558]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f3b6a589-19c5-4dd5-baad-a5fe12e69979 tempest-VolumesDeleteCascade-1413170871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5" returned: 0 in 0.872s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-f3b6a589-19c5-4dd5-baad-a5fe12e69979 tempest-VolumesDeleteCascade-1413170871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f3b6a589-19c5-4dd5-baad-a5fe12e69979 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.2c9a2d0b-92f7-4273-9e5f-7168fbd4c965 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:19 devstack sudo[85560]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_hlp8l34q" returned: 0 in 0.829s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_hlp8l34q {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:19 devstack sudo[85575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.2c9a2d0b-92f7-4273-9e5f-7168fbd4c965 1G Apr 21 20:54:19 devstack sudo[85575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:19 devstack sudo[85576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_hlp8l34q Apr 21 20:54:19 devstack sudo[85576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:20 devstack sudo[85575]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f3b6a589-19c5-4dd5-baad-a5fe12e69979 tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.2c9a2d0b-92f7-4273-9e5f-7168fbd4c965 1G" returned: 0 in 0.804s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f3b6a589-19c5-4dd5-baad-a5fe12e69979 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.2c9a2d0b-92f7-4273-9e5f-7168fbd4c965 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:20 devstack sudo[85592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.2c9a2d0b-92f7-4273-9e5f-7168fbd4c965 Apr 21 20:54:20 devstack sudo[85592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:20 devstack sudo[85576]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_hlp8l34q" returned: 1 in 0.994s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_hlp8l34q' failed. Not Retrying. {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:54:20 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[73df9ca0-227e-4ebe-b8ef-132c20732688]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_pk2hofv6devstack@QuobyteHD {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:20 devstack sudo[85571]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_eem5gwazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7" returned: 0 in 1.208s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:20 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_eem5gwazdevstack@QuobyteHD, size 112.00 MB, duration 1.21 sec, destination /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7 {{(pid=81957) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:54:20 devstack cinder-volume[81957]: INFO cinder.image.image_utils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Converted 112.00 MB image at 92.62 MB/s Apr 21 20:54:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:20 devstack sudo[85595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_pk2hofv6devstack@QuobyteHD Apr 21 20:54:20 devstack sudo[85595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:20 devstack sudo[85596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7 1G Apr 21 20:54:20 devstack sudo[85596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:20 devstack sudo[85592]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f3b6a589-19c5-4dd5-baad-a5fe12e69979 tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.2c9a2d0b-92f7-4273-9e5f-7168fbd4c965" returned: 0 in 0.678s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:20 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-f3b6a589-19c5-4dd5-baad-a5fe12e69979 tempest-VolumesDeleteCascade-1413170871 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.2c9a2d0b-92f7-4273-9e5f-7168fbd4c965 is being set with open permissions: ugo+rw Apr 21 20:54:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f3b6a589-19c5-4dd5-baad-a5fe12e69979 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.2c9a2d0b-92f7-4273-9e5f-7168fbd4c965 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:20 devstack sudo[85602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.2c9a2d0b-92f7-4273-9e5f-7168fbd4c965 Apr 21 20:54:20 devstack sudo[85602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:20 devstack sudo[85595]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_pk2hofv6devstack@QuobyteHD" returned: 0 in 0.675s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:20 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] 1c112cf7-9f7d-490e-8e52-abb08838bafa was qcow2, converting to raw {{(pid=81957) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 21 20:54:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_pk2hofv6devstack@QuobyteHD /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:20 devstack sudo[85610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_pk2hofv6devstack@QuobyteHD /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 Apr 21 20:54:20 devstack sudo[85610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:21 devstack sudo[85596]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7 1G" returned: 0 in 0.642s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:21 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af66bb8-ea9e-4bfe-8fd6-f69ec4f411a0]: (4, 'raw') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:21 devstack sudo[85612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7 Apr 21 20:54:21 devstack sudo[85612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:21 devstack sudo[85602]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f3b6a589-19c5-4dd5-baad-a5fe12e69979 tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.2c9a2d0b-92f7-4273-9e5f-7168fbd4c965" returned: 0 in 0.680s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f3b6a589-19c5-4dd5-baad-a5fe12e69979 tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.131s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:21 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-f3b6a589-19c5-4dd5-baad-a5fe12e69979 tempest-VolumesDeleteCascade-1413170871 None] Create snapshot completed successfully Apr 21 20:54:21 devstack sudo[85612]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7" returned: 0 in 0.892s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:22 devstack sudo[85610]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_pk2hofv6devstack@QuobyteHD /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52" returned: 0 in 1.078s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_pk2hofv6devstack@QuobyteHD, size 112.00 MB, duration 1.08 sec, destination /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 {{(pid=81957) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:54:22 devstack cinder-volume[81957]: INFO cinder.image.image_utils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Converted 112.00 MB image at 103.74 MB/s Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:22 devstack sudo[85623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7 Apr 21 20:54:22 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:22 devstack sudo[85624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 1G Apr 21 20:54:22 devstack sudo[85624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "cinder-256561c7-1bbe-4a88-a80f-05d5ee9f4f42-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-256561c7-1bbe-4a88-a80f-05d5ee9f4f42-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Performing cascade delete. {{(pid=81957) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "cinder-2c9a2d0b-92f7-4273-9e5f-7168fbd4c965-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-2c9a2d0b-92f7-4273-9e5f-7168fbd4c965-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "cinder-quobyte-256561c7-1bbe-4a88-a80f-05d5ee9f4f42" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-quobyte-256561c7-1bbe-4a88-a80f-05d5ee9f4f42" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "cinder-quobyte-2c9a2d0b-92f7-4273-9e5f-7168fbd4c965" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-quobyte-2c9a2d0b-92f7-4273-9e5f-7168fbd4c965" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Deleting offline snapshot 2c9a2d0b-92f7-4273-9e5f-7168fbd4c965 of volume 256561c7-1bbe-4a88-a80f-05d5ee9f4f42 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] snapshot_file for this snap is: volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.2c9a2d0b-92f7-4273-9e5f-7168fbd4c965 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfdbedc-1fda-4d12-adb1-bcc793160ed4]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.2c9a2d0b-92f7-4273-9e5f-7168fbd4c965 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:22 devstack sudo[85627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.2c9a2d0b-92f7-4273-9e5f-7168fbd4c965 Apr 21 20:54:22 devstack sudo[85627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:22 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7" returned: 1 in 0.755s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7' failed. Not Retrying. {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG cinder.volume.volume_utils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Downloaded image 1c112cf7-9f7d-490e-8e52-abb08838bafa ((None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}])) to volume a577e9ff-3dde-44d5-b180-6c7d91bce8e7 successfully. {{(pid=81957) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Temporary image 1c112cf7-9f7d-490e-8e52-abb08838bafa for user ccbbd6323cee4881ac9b7de565d60446 is deleted. {{(pid=81957) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG cinder.volume.volume_utils [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Marking volume a577e9ff-3dde-44d5-b180-6c7d91bce8e7 as bootable. {{(pid=81957) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Copying metadata from image 1c112cf7-9f7d-490e-8e52-abb08838bafa to a577e9ff-3dde-44d5-b180-6c7d91bce8e7. {{(pid=81957) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Creating volume glance metadata for volume a577e9ff-3dde-44d5-b180-6c7d91bce8e7 backed by image 1c112cf7-9f7d-490e-8e52-abb08838bafa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81957) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c51808-3e0f-4ffb-a700-00260e52f539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7', 'volume_size': 1, 'image_id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea9a1f20637b41ec8f283a778363aed0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c112cf7-9f7d-490e-8e52-abb08838bafa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d96df8-73d9-4347-bd3a-319e662a4c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:22 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Volume volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7 (a577e9ff-3dde-44d5-b180-6c7d91bce8e7): created successfully Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d96df8-73d9-4347-bd3a-319e662a4c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Flow 'volume_create_manager' (9d4c8d80-012e-47f6-bfce-4647b0d7bcce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:22 devstack sudo[85624]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 1G" returned: 0 in 0.926s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:22 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-c078cc13-6a83-4e54-89f3-63eef0e1b0d9 tempest-VolumesImageMetadata-84639588 None] Created volume successfully. Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c432fe-1e43-49ff-82d0-9cf60f6b5528]: (4, 'raw') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:23 devstack sudo[85637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 Apr 21 20:54:23 devstack sudo[85637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:23 devstack sudo[85627]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.2c9a2d0b-92f7-4273-9e5f-7168fbd4c965" returned: 0 in 0.802s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:23 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:23 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[b263aafb-971f-48e2-becf-2e7035dc3e86]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:23 devstack sudo[85640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 Apr 21 20:54:23 devstack sudo[85640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:23 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-013d0536-0b24-432f-9465-8125dbf0670b tempest-VolumesImageMetadata-84639588 None] Acquiring lock "cinder-a577e9ff-3dde-44d5-b180-6c7d91bce8e7-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:23 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-013d0536-0b24-432f-9465-8125dbf0670b tempest-VolumesImageMetadata-84639588 None] Lock "cinder-a577e9ff-3dde-44d5-b180-6c7d91bce8e7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:23 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-013d0536-0b24-432f-9465-8125dbf0670b tempest-VolumesImageMetadata-84639588 None] Acquiring lock "cinder-quobyte-a577e9ff-3dde-44d5-b180-6c7d91bce8e7" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:23 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-013d0536-0b24-432f-9465-8125dbf0670b tempest-VolumesImageMetadata-84639588 None] Lock "cinder-quobyte-a577e9ff-3dde-44d5-b180-6c7d91bce8e7" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:23 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bf8aae-1863-4a9d-8b45-3dfc91c38548]: (4, 'raw') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-013d0536-0b24-432f-9465-8125dbf0670b tempest-VolumesImageMetadata-84639588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:23 devstack sudo[85637]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52" returned: 0 in 0.748s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:23 devstack sudo[85645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 Apr 21 20:54:23 devstack sudo[85645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:23 devstack sudo[85644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7 Apr 21 20:54:23 devstack sudo[85644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:24 devstack sudo[85640]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5" returned: 0 in 0.830s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:24 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.2c9a2d0b-92f7-4273-9e5f-7168fbd4c965 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:24 devstack sudo[85651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.2c9a2d0b-92f7-4273-9e5f-7168fbd4c965 Apr 21 20:54:24 devstack sudo[85651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:24 devstack sudo[85645]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52" returned: 1 in 0.578s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52' failed. Not Retrying. {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:54:24 devstack cinder-volume[81957]: DEBUG cinder.volume.volume_utils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Downloaded image 1c112cf7-9f7d-490e-8e52-abb08838bafa ((None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}])) to volume 66f66f3b-e7da-404b-949d-6a317e298a52 successfully. {{(pid=81957) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 21 20:54:24 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Temporary image 1c112cf7-9f7d-490e-8e52-abb08838bafa for user 1e38afaf8abb4513be76f05aba60a3b7 is deleted. {{(pid=81957) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 21 20:54:24 devstack cinder-volume[81957]: DEBUG cinder.volume.volume_utils [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Marking volume 66f66f3b-e7da-404b-949d-6a317e298a52 as bootable. {{(pid=81957) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 21 20:54:24 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Copying metadata from image 1c112cf7-9f7d-490e-8e52-abb08838bafa to 66f66f3b-e7da-404b-949d-6a317e298a52. {{(pid=81957) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 21 20:54:24 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Creating volume glance metadata for volume 66f66f3b-e7da-404b-949d-6a317e298a52 backed by image 1c112cf7-9f7d-490e-8e52-abb08838bafa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81957) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 21 20:54:24 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a568a7-554c-4824-9bec-81a3c525b14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66f66f3b-e7da-404b-949d-6a317e298a52', 'volume_size': 1, 'image_id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea9a1f20637b41ec8f283a778363aed0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c112cf7-9f7d-490e-8e52-abb08838bafa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:24 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bb053a-c27c-46fd-9cdf-4d2ee77c4f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:24 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Volume volume-66f66f3b-e7da-404b-949d-6a317e298a52 (66f66f3b-e7da-404b-949d-6a317e298a52): created successfully Apr 21 20:54:24 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bb053a-c27c-46fd-9cdf-4d2ee77c4f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:24 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Flow 'volume_create_manager' (33916a51-5dbc-4e83-8f2c-5c6c67f06619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:24 devstack cinder-volume[81957]: INFO cinder.volume.manager [req-c54281dd-13e7-457e-9757-2da82831f72f req-4abcdc82-37f4-408f-b849-67c4d8550894 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Created volume successfully. Apr 21 20:54:24 devstack sudo[85644]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-013d0536-0b24-432f-9465-8125dbf0670b tempest-VolumesImageMetadata-84639588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7" returned: 0 in 0.864s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-013d0536-0b24-432f-9465-8125dbf0670b tempest-VolumesImageMetadata-84639588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:24 devstack sudo[85660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7 Apr 21 20:54:24 devstack sudo[85660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:24 devstack sudo[85651]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.2c9a2d0b-92f7-4273-9e5f-7168fbd4c965" returned: 0 in 0.844s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.2c9a2d0b-92f7-4273-9e5f-7168fbd4c965 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:24 devstack sudo[85665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.2c9a2d0b-92f7-4273-9e5f-7168fbd4c965 Apr 21 20:54:24 devstack sudo[85665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:25 devstack sudo[85660]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-013d0536-0b24-432f-9465-8125dbf0670b tempest-VolumesImageMetadata-84639588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7" returned: 1 in 0.630s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-013d0536-0b24-432f-9465-8125dbf0670b tempest-VolumesImageMetadata-84639588 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7' failed. Not Retrying. {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-013d0536-0b24-432f-9465-8125dbf0670b tempest-VolumesImageMetadata-84639588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:25 devstack sudo[85670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7 Apr 21 20:54:25 devstack sudo[85670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:25 devstack sudo[85665]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.2c9a2d0b-92f7-4273-9e5f-7168fbd4c965" returned: 0 in 0.639s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-quobyte-2c9a2d0b-92f7-4273-9e5f-7168fbd4c965" released by "_delete_snapshot" :: held 3.167s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-quobyte-256561c7-1bbe-4a88-a80f-05d5ee9f4f42" released by "delete_snapshot" :: held 3.180s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-993c553c-aff5-4386-b729-1be12a8c9351 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-993c553c-aff5-4386-b729-1be12a8c9351 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[c031891d-eb30-4e29-9d82-b145ed309b24]: (4, 'raw') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-993c553c-aff5-4386-b729-1be12a8c9351 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Created reservations ['6def02f8-881e-4d86-b717-b23c31c2b64e', '120bb507-414f-4912-93eb-9b99f6e34f4c', 'c6a40436-8ca8-4982-8e0d-0b92d53aee7e', '02daae9e-c4fd-4440-a076-9019d01e7845'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:25 devstack sudo[85681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 Apr 21 20:54:25 devstack sudo[85681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:25 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Delete snapshot completed successfully. Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-2c9a2d0b-92f7-4273-9e5f-7168fbd4c965-delete_snapshot" released by "delete_snapshot" :: held 3.456s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "cinder-beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "cinder-quobyte-256561c7-1bbe-4a88-a80f-05d5ee9f4f42" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-quobyte-256561c7-1bbe-4a88-a80f-05d5ee9f4f42" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "cinder-quobyte-beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-quobyte-beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Deleting offline snapshot beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 of volume 256561c7-1bbe-4a88-a80f-05d5ee9f4f42 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] snapshot_file for this snap is: volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[c216ed7e-e900-4f30-ac5e-4566131bf11d]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:25 devstack sudo[85683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 Apr 21 20:54:25 devstack sudo[85683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:25 devstack sudo[85670]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-013d0536-0b24-432f-9465-8125dbf0670b tempest-VolumesImageMetadata-84639588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a577e9ff-3dde-44d5-b180-6c7d91bce8e7" returned: 0 in 0.780s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-013d0536-0b24-432f-9465-8125dbf0670b tempest-VolumesImageMetadata-84639588 None] Lock "cinder-quobyte-a577e9ff-3dde-44d5-b180-6c7d91bce8e7" released by "delete_volume" :: held 2.348s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:26 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-013d0536-0b24-432f-9465-8125dbf0670b tempest-VolumesImageMetadata-84639588 None] Created reservations ['957ba05f-b815-4a40-80d1-dc23a686977e', '81d45d54-1d8d-4d87-a108-ce2de14d7636', 'aea595f4-051c-439c-b062-4b5b3bc82377', '4ba609b8-1923-421d-9ee1-b7deeaab03d9'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-013d0536-0b24-432f-9465-8125dbf0670b tempest-VolumesImageMetadata-84639588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-013d0536-0b24-432f-9465-8125dbf0670b tempest-VolumesImageMetadata-84639588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:26 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-013d0536-0b24-432f-9465-8125dbf0670b tempest-VolumesImageMetadata-84639588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:26 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-013d0536-0b24-432f-9465-8125dbf0670b tempest-VolumesImageMetadata-84639588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-013d0536-0b24-432f-9465-8125dbf0670b tempest-VolumesImageMetadata-84639588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-013d0536-0b24-432f-9465-8125dbf0670b tempest-VolumesImageMetadata-84639588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:26 devstack sudo[85686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:54:26 devstack sudo[85686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:26 devstack sudo[85681]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-993c553c-aff5-4386-b729-1be12a8c9351 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52" returned: 0 in 0.766s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-993c553c-aff5-4386-b729-1be12a8c9351 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:26 devstack sudo[85693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 Apr 21 20:54:26 devstack sudo[85693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:26 devstack sudo[85683]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5" returned: 0 in 0.611s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:26 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:26 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a526a86-735d-494f-92d7-4d294cb2f5da]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:26 devstack sudo[85695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42 Apr 21 20:54:26 devstack sudo[85695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:26 devstack sudo[85686]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-013d0536-0b24-432f-9465-8125dbf0670b tempest-VolumesImageMetadata-84639588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.561s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:26 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-013d0536-0b24-432f-9465-8125dbf0670b tempest-VolumesImageMetadata-84639588 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:26 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-013d0536-0b24-432f-9465-8125dbf0670b tempest-VolumesImageMetadata-84639588 None] Deleted volume successfully. Apr 21 20:54:26 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-013d0536-0b24-432f-9465-8125dbf0670b tempest-VolumesImageMetadata-84639588 None] Lock "cinder-a577e9ff-3dde-44d5-b180-6c7d91bce8e7-delete_volume" released by "delete_volume" :: held 3.072s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:27 devstack sudo[85693]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-993c553c-aff5-4386-b729-1be12a8c9351 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52" returned: 1 in 0.642s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-993c553c-aff5-4386-b729-1be12a8c9351 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52' failed. Not Retrying. {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:54:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-c54281dd-13e7-457e-9757-2da82831f72f req-993c553c-aff5-4386-b729-1be12a8c9351 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.440s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-c54281dd-13e7-457e-9757-2da82831f72f req-993c553c-aff5-4386-b729-1be12a8c9351 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7', 'name': 'volume-66f66f3b-e7da-404b-949d-6a317e298a52', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '283f0a93-f999-4791-a194-41f11343157c', 'enforce_multipath': True} {{(pid=81957) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 21 20:54:27 devstack sudo[85695]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42" returned: 0 in 0.586s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:27 devstack sudo[85704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 Apr 21 20:54:27 devstack sudo[85704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:27 devstack cinder-volume[81957]: INFO cinder.volume.manager [req-c54281dd-13e7-457e-9757-2da82831f72f req-993c553c-aff5-4386-b729-1be12a8c9351 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] attachment_update completed successfully. Apr 21 20:54:27 devstack sudo[85704]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5" returned: 0 in 0.560s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:27 devstack sudo[85709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5 Apr 21 20:54:27 devstack sudo[85709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:27 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Flow 'volume_create_manager' (1e3e3efa-c89b-4890-b7bb-8a408876f3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916c6eab-d521-4eb1-924a-8bbd83c76732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916c6eab-d521-4eb1-924a-8bbd83c76732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-273877280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4527cf7a-142f-4597-bf92-a53802c5f1d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c56ed10f5764e24a1674231a99404c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:28Z,use_quota=True,user_id='9d5e772d2d244f6792fdd7f8d37f0909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d338e3b4-556c-4e7a-b11e-f92f43ad56a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d338e3b4-556c-4e7a-b11e-f92f43ad56a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f5b1afc-8eef-46c3-ab1c-a3e1bb557bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f5b1afc-8eef-46c3-ab1c-a3e1bb557bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4527cf7a-142f-4597-bf92-a53802c5f1d7', 'volume_name': 'volume-4527cf7a-142f-4597-bf92-a53802c5f1d7', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c546433f-c210-4005-9d9c-51575d406804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c546433f-c210-4005-9d9c-51575d406804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63aaf7d8-3d5c-41a0-b557-76906c3bd914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:28 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Volume 4527cf7a-142f-4597-bf92-a53802c5f1d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4527cf7a-142f-4597-bf92-a53802c5f1d7', 'volume_size': 1} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-273877280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4527cf7a-142f-4597-bf92-a53802c5f1d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c56ed10f5764e24a1674231a99404c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:28Z,use_quota=True,user_id='9d5e772d2d244f6792fdd7f8d37f0909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Creating volume 4527cf7a-142f-4597-bf92-a53802c5f1d7 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:28 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4527cf7a-142f-4597-bf92-a53802c5f1d7 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:28 devstack sudo[85712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4527cf7a-142f-4597-bf92-a53802c5f1d7 1073741824 Apr 21 20:54:28 devstack sudo[85712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:28 devstack sudo[85709]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42.beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5" returned: 0 in 0.478s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-quobyte-beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5" released by "_delete_snapshot" :: held 2.291s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-quobyte-256561c7-1bbe-4a88-a80f-05d5ee9f4f42" released by "delete_snapshot" :: held 2.313s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Created reservations ['a1242aa8-393f-4c6f-af95-df58f034f432', '412d77a2-6ede-49be-852b-b1cc76610abe', 'a9d4ce92-197d-4752-aab5-702f0b6b6971', 'b6143954-c050-41a7-ac06-ed4630f31055'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:28 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Delete snapshot completed successfully. Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-beaa1c2d-ba4a-4b6a-8ff1-8f227b315fd5-delete_snapshot" released by "delete_snapshot" :: held 2.440s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Snapshots deleted, issuing volume delete {{(pid=81957) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "cinder-quobyte-256561c7-1bbe-4a88-a80f-05d5ee9f4f42" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-quobyte-256561c7-1bbe-4a88-a80f-05d5ee9f4f42" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ec9914-4c80-4c01-8064-8ba324c45f60]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:28 devstack sudo[85714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42 Apr 21 20:54:28 devstack sudo[85714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:28 devstack sudo[85712]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4527cf7a-142f-4597-bf92-a53802c5f1d7 1073741824" returned: 0 in 0.592s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4527cf7a-142f-4597-bf92-a53802c5f1d7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:28 devstack sudo[85720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4527cf7a-142f-4597-bf92-a53802c5f1d7 Apr 21 20:54:28 devstack sudo[85720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:28 devstack sudo[85714]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42" returned: 0 in 0.531s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:28 devstack sudo[85724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42 Apr 21 20:54:28 devstack sudo[85724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:29 devstack sudo[85720]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4527cf7a-142f-4597-bf92-a53802c5f1d7" returned: 0 in 0.462s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63aaf7d8-3d5c-41a0-b557-76906c3bd914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4527cf7a-142f-4597-bf92-a53802c5f1d7', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f79480a-8fe5-4a0e-89e5-0f02541cb5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:29 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Volume volume-4527cf7a-142f-4597-bf92-a53802c5f1d7 (4527cf7a-142f-4597-bf92-a53802c5f1d7): created successfully Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f79480a-8fe5-4a0e-89e5-0f02541cb5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Flow 'volume_create_manager' (1e3e3efa-c89b-4890-b7bb-8a408876f3ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:29 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-1188e925-89c7-4b60-81b3-ffa81f3326c2 tempest-VolumesMetadataTest-1571846664 None] Created volume successfully. Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Flow 'volume_create_manager' (d0f51298-e22e-49e0-b459-92a290c290de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3aac8a-e55a-402b-827c-928ebdc446d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3aac8a-e55a-402b-827c-928ebdc446d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1871754673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebdcd526-ad56-40b0-863c-c91fe70d805b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec99f0343a1a49e48844e8ab1a6dcfcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:29Z,use_quota=True,user_id='e202a3a0a3834682b111a19da399191f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2589aba-743b-4733-9908-5f838f2b6d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2589aba-743b-4733-9908-5f838f2b6d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c6e686-22ce-44fc-8454-1c2e9e605eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c6e686-22ce-44fc-8454-1c2e9e605eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebdcd526-ad56-40b0-863c-c91fe70d805b', 'volume_name': 'volume-ebdcd526-ad56-40b0-863c-c91fe70d805b', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1a7255-0bf2-4c36-a696-f24ae9797ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1a7255-0bf2-4c36-a696-f24ae9797ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55af4da1-a822-4325-b44b-6ab099b75f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:29 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Volume ebdcd526-ad56-40b0-863c-c91fe70d805b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebdcd526-ad56-40b0-863c-c91fe70d805b', 'volume_size': 1} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:29 devstack sudo[85724]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1871754673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebdcd526-ad56-40b0-863c-c91fe70d805b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec99f0343a1a49e48844e8ab1a6dcfcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:29Z,use_quota=True,user_id='e202a3a0a3834682b111a19da399191f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Creating volume ebdcd526-ad56-40b0-863c-c91fe70d805b {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:29 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-256561c7-1bbe-4a88-a80f-05d5ee9f4f42" returned: 0 in 0.480s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-quobyte-256561c7-1bbe-4a88-a80f-05d5ee9f4f42" released by "delete_volume" :: held 1.041s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:29 devstack sudo[85729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b 1073741824 Apr 21 20:54:29 devstack sudo[85729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Created reservations ['cd6b5131-d274-44ef-8556-2f308f5309b5', '65279c09-33b5-467d-aafd-77539498e077', '02723394-d84b-4f37-ba9f-f2c5450a62a1', '81efe536-c3dd-4496-b5dc-f22aba4ded88'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:29 devstack sudo[85731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:54:29 devstack sudo[85731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:29 devstack sudo[85729]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b 1073741824" returned: 0 in 0.507s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:29 devstack sudo[85731]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.417s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:29 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Deleted volume successfully. Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:29 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2c0bc2ce-75c0-4dad-b3bb-404e30da4521 tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-256561c7-1bbe-4a88-a80f-05d5ee9f4f42-delete_volume" released by "delete_volume" :: held 7.579s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:29 devstack sudo[85737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b Apr 21 20:54:29 devstack sudo[85737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Flow 'volume_create_manager' (8d2b4173-93ba-4c0e-b89d-caaf80bc5e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6451a94e-9569-40a5-baa7-8e67cc721800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:30 devstack sudo[85737]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6451a94e-9569-40a5-baa7-8e67cc721800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1351128837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5eb1f1-6032-4f52-a20b-f39474de5a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a67d0f6337040c486db592b492a5610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:30Z,use_quota=True,user_id='c992c28659674ca08588f1f7bd2d2611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de97464-dec6-4bcf-83c6-d985e1ef4205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de97464-dec6-4bcf-83c6-d985e1ef4205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb46a265-b74b-4b87-8f84-114348da9c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb46a265-b74b-4b87-8f84-114348da9c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a5eb1f1-6032-4f52-a20b-f39474de5a30', 'volume_name': 'volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23dc6482-5359-40a2-b543-c91a1b559c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23dc6482-5359-40a2-b543-c91a1b559c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9811b2-5b3e-48f5-a52b-75619d5b2f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:30 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Volume 7a5eb1f1-6032-4f52-a20b-f39474de5a30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30', 'volume_size': 1} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b" returned: 0 in 0.537s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1351128837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5eb1f1-6032-4f52-a20b-f39474de5a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a67d0f6337040c486db592b492a5610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:30Z,use_quota=True,user_id='c992c28659674ca08588f1f7bd2d2611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Creating volume 7a5eb1f1-6032-4f52-a20b-f39474de5a30 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:30 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55af4da1-a822-4325-b44b-6ab099b75f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebdcd526-ad56-40b0-863c-c91fe70d805b', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:30 devstack sudo[85743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 1073741824 Apr 21 20:54:30 devstack sudo[85743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c676a37-f8f4-4bf6-a57c-eb6fa7119408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:30 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Volume volume-ebdcd526-ad56-40b0-863c-c91fe70d805b (ebdcd526-ad56-40b0-863c-c91fe70d805b): created successfully Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c676a37-f8f4-4bf6-a57c-eb6fa7119408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Flow 'volume_create_manager' (d0f51298-e22e-49e0-b459-92a290c290de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:30 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-7877b1f1-e049-45d2-9e1d-9e3ed6384bc2 tempest-SnapshotMetadataTestJSON-980295510 None] Created volume successfully. Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-fc9ac1e7-1b4c-431d-a4f6-14e5dca52fd7 tempest-VolumesMetadataTest-1571846664 None] Acquiring lock "cinder-4527cf7a-142f-4597-bf92-a53802c5f1d7-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-fc9ac1e7-1b4c-431d-a4f6-14e5dca52fd7 tempest-VolumesMetadataTest-1571846664 None] Lock "cinder-4527cf7a-142f-4597-bf92-a53802c5f1d7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-fc9ac1e7-1b4c-431d-a4f6-14e5dca52fd7 tempest-VolumesMetadataTest-1571846664 None] Acquiring lock "cinder-quobyte-4527cf7a-142f-4597-bf92-a53802c5f1d7" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-fc9ac1e7-1b4c-431d-a4f6-14e5dca52fd7 tempest-VolumesMetadataTest-1571846664 None] Lock "cinder-quobyte-4527cf7a-142f-4597-bf92-a53802c5f1d7" acquired by "delete_volume" :: waited 0.013s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe56c501-ad66-48e7-a8b1-f1ef9d3e1a0a]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fc9ac1e7-1b4c-431d-a4f6-14e5dca52fd7 tempest-VolumesMetadataTest-1571846664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4527cf7a-142f-4597-bf92-a53802c5f1d7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:30 devstack sudo[85745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4527cf7a-142f-4597-bf92-a53802c5f1d7 Apr 21 20:54:30 devstack sudo[85745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:30 devstack sudo[85743]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 1073741824" returned: 0 in 0.558s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:30 devstack sudo[85750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 Apr 21 20:54:30 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:31 devstack sudo[85745]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fc9ac1e7-1b4c-431d-a4f6-14e5dca52fd7 tempest-VolumesMetadataTest-1571846664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4527cf7a-142f-4597-bf92-a53802c5f1d7" returned: 0 in 0.481s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fc9ac1e7-1b4c-431d-a4f6-14e5dca52fd7 tempest-VolumesMetadataTest-1571846664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4527cf7a-142f-4597-bf92-a53802c5f1d7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:31 devstack sudo[85755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4527cf7a-142f-4597-bf92-a53802c5f1d7 Apr 21 20:54:31 devstack sudo[85755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:31 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30" returned: 0 in 0.425s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:31 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9811b2-5b3e-48f5-a52b-75619d5b2f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be62ac8b-c39d-4c75-8e67-8960ee1f9ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:31 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Volume volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 (7a5eb1f1-6032-4f52-a20b-f39474de5a30): created successfully Apr 21 20:54:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be62ac8b-c39d-4c75-8e67-8960ee1f9ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Flow 'volume_create_manager' (8d2b4173-93ba-4c0e-b89d-caaf80bc5e92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:31 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-e9cff5f6-03db-4eb4-9c1f-3b968c09ddb0 tempest-VolumesDeleteCascade-1413170871 None] Created volume successfully. Apr 21 20:54:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0cea34db-c07d-4f47-bddf-874a7490df52 tempest-SnapshotMetadataTestJSON-980295510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0cea34db-c07d-4f47-bddf-874a7490df52 tempest-SnapshotMetadataTestJSON-980295510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:31 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-0cea34db-c07d-4f47-bddf-874a7490df52 tempest-SnapshotMetadataTestJSON-980295510 None] Creating offline snapshot 09c9d9d0-e89c-4494-9f41-e52fd575f2ce of volume ebdcd526-ad56-40b0-863c-c91fe70d805b {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:54:31 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f47d28-6231-4d07-98e6-d50c09e96a4f]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0cea34db-c07d-4f47-bddf-874a7490df52 tempest-SnapshotMetadataTestJSON-980295510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:31 devstack sudo[85758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b Apr 21 20:54:31 devstack sudo[85758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:31 devstack sudo[85755]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fc9ac1e7-1b4c-431d-a4f6-14e5dca52fd7 tempest-VolumesMetadataTest-1571846664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4527cf7a-142f-4597-bf92-a53802c5f1d7" returned: 0 in 0.459s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:31 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-fc9ac1e7-1b4c-431d-a4f6-14e5dca52fd7 tempest-VolumesMetadataTest-1571846664 None] Lock "cinder-quobyte-4527cf7a-142f-4597-bf92-a53802c5f1d7" released by "delete_volume" :: held 0.964s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:31 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-fc9ac1e7-1b4c-431d-a4f6-14e5dca52fd7 tempest-VolumesMetadataTest-1571846664 None] Created reservations ['8f97b41a-21ad-4818-aa74-2321eef9120c', 'c6fd62fd-4de2-46f0-9186-6fca53d077ea', '3c046503-6a49-416b-8fcd-6ea856e7d163', 'c654dab5-a5bd-4d0f-9500-7a68620ad099'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fc9ac1e7-1b4c-431d-a4f6-14e5dca52fd7 tempest-VolumesMetadataTest-1571846664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fc9ac1e7-1b4c-431d-a4f6-14e5dca52fd7 tempest-VolumesMetadataTest-1571846664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:31 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fc9ac1e7-1b4c-431d-a4f6-14e5dca52fd7 tempest-VolumesMetadataTest-1571846664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:31 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fc9ac1e7-1b4c-431d-a4f6-14e5dca52fd7 tempest-VolumesMetadataTest-1571846664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fc9ac1e7-1b4c-431d-a4f6-14e5dca52fd7 tempest-VolumesMetadataTest-1571846664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fc9ac1e7-1b4c-431d-a4f6-14e5dca52fd7 tempest-VolumesMetadataTest-1571846664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:31 devstack sudo[85775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:54:31 devstack sudo[85775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:32 devstack sudo[85758]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0cea34db-c07d-4f47-bddf-874a7490df52 tempest-SnapshotMetadataTestJSON-980295510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b" returned: 0 in 1.197s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0cea34db-c07d-4f47-bddf-874a7490df52 tempest-SnapshotMetadataTestJSON-980295510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.09c9d9d0-e89c-4494-9f41-e52fd575f2ce 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:32 devstack sudo[85793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.09c9d9d0-e89c-4494-9f41-e52fd575f2ce 1G Apr 21 20:54:32 devstack sudo[85793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:32 devstack sudo[85775]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fc9ac1e7-1b4c-431d-a4f6-14e5dca52fd7 tempest-VolumesMetadataTest-1571846664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 1.042s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:32 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-fc9ac1e7-1b4c-431d-a4f6-14e5dca52fd7 tempest-VolumesMetadataTest-1571846664 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:32 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-fc9ac1e7-1b4c-431d-a4f6-14e5dca52fd7 tempest-VolumesMetadataTest-1571846664 None] Deleted volume successfully. Apr 21 20:54:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-02f45ea9-692d-4f84-9171-a5d8bdc53414 tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:32 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-fc9ac1e7-1b4c-431d-a4f6-14e5dca52fd7 tempest-VolumesMetadataTest-1571846664 None] Lock "cinder-4527cf7a-142f-4597-bf92-a53802c5f1d7-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:33 devstack sudo[85793]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0cea34db-c07d-4f47-bddf-874a7490df52 tempest-SnapshotMetadataTestJSON-980295510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.09c9d9d0-e89c-4494-9f41-e52fd575f2ce 1G" returned: 0 in 1.067s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0cea34db-c07d-4f47-bddf-874a7490df52 tempest-SnapshotMetadataTestJSON-980295510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebdcd526-ad56-40b0-863c-c91fe70d805b -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.09c9d9d0-e89c-4494-9f41-e52fd575f2ce {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:33 devstack sudo[85799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebdcd526-ad56-40b0-863c-c91fe70d805b -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.09c9d9d0-e89c-4494-9f41-e52fd575f2ce Apr 21 20:54:33 devstack sudo[85799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:34 devstack sudo[85799]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0cea34db-c07d-4f47-bddf-874a7490df52 tempest-SnapshotMetadataTestJSON-980295510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebdcd526-ad56-40b0-863c-c91fe70d805b -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.09c9d9d0-e89c-4494-9f41-e52fd575f2ce" returned: 0 in 0.637s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:34 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-0cea34db-c07d-4f47-bddf-874a7490df52 tempest-SnapshotMetadataTestJSON-980295510 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.09c9d9d0-e89c-4494-9f41-e52fd575f2ce is being set with open permissions: ugo+rw Apr 21 20:54:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0cea34db-c07d-4f47-bddf-874a7490df52 tempest-SnapshotMetadataTestJSON-980295510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.09c9d9d0-e89c-4494-9f41-e52fd575f2ce {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:34 devstack sudo[85805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.09c9d9d0-e89c-4494-9f41-e52fd575f2ce Apr 21 20:54:34 devstack sudo[85805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:34 devstack sudo[85805]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0cea34db-c07d-4f47-bddf-874a7490df52 tempest-SnapshotMetadataTestJSON-980295510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.09c9d9d0-e89c-4494-9f41-e52fd575f2ce" returned: 0 in 0.543s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0cea34db-c07d-4f47-bddf-874a7490df52 tempest-SnapshotMetadataTestJSON-980295510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:34 devstack sudo[85808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.info Apr 21 20:54:34 devstack sudo[85808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:35 devstack sudo[85808]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0cea34db-c07d-4f47-bddf-874a7490df52 tempest-SnapshotMetadataTestJSON-980295510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.info" returned: 0 in 0.513s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:35 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-0cea34db-c07d-4f47-bddf-874a7490df52 tempest-SnapshotMetadataTestJSON-980295510 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.info is being set with open permissions: ugo+rw Apr 21 20:54:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0cea34db-c07d-4f47-bddf-874a7490df52 tempest-SnapshotMetadataTestJSON-980295510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:35 devstack sudo[85811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.info Apr 21 20:54:35 devstack sudo[85811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:36 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:SELECT=145,cinder:INSERT=48,cinder:UPDATE=178,cinder:DELETE=12 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:54:36 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:36 devstack sudo[85811]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Flow 'volume_create_manager' (d90381dd-3ece-4c42-ad8d-0d29190935f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa56557-f8a7-4232-976f-628432d21c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:36 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:SELECT=146,cinder:UPDATE=173,cinder:INSERT=60,cinder:DELETE=19 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:54:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0cea34db-c07d-4f47-bddf-874a7490df52 tempest-SnapshotMetadataTestJSON-980295510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.info" returned: 0 in 0.671s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0cea34db-c07d-4f47-bddf-874a7490df52 tempest-SnapshotMetadataTestJSON-980295510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.698s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-02f45ea9-692d-4f84-9171-a5d8bdc53414 tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.367s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa56557-f8a7-4232-976f-628432d21c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-422459437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad603fb8-3146-40ab-9298-881218afc8cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6c5c861705f42f98a18047ed7e7ff39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:36Z,use_quota=True,user_id='32f93bc4ed704fc1bba46695a26dd0e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (669a217a-a6b9-420d-a45e-ec3298c63863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (669a217a-a6b9-420d-a45e-ec3298c63863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829e7001-9221-4da4-ac75-589cc26f74cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829e7001-9221-4da4-ac75-589cc26f74cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad603fb8-3146-40ab-9298-881218afc8cd', 'volume_name': 'volume-ad603fb8-3146-40ab-9298-881218afc8cd', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c90c2a8-59fe-4288-965e-479bc6d4e3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c90c2a8-59fe-4288-965e-479bc6d4e3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f4350d-0d65-4e83-9fc4-67e988f4c966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:36 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Volume ad603fb8-3146-40ab-9298-881218afc8cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad603fb8-3146-40ab-9298-881218afc8cd', 'volume_size': 1} Apr 21 20:54:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:36 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-0cea34db-c07d-4f47-bddf-874a7490df52 tempest-SnapshotMetadataTestJSON-980295510 None] Create snapshot completed successfully Apr 21 20:54:36 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-02f45ea9-692d-4f84-9171-a5d8bdc53414 tempest-VolumesDeleteCascade-1413170871 None] Creating offline snapshot afea2b6b-0225-4c4e-841f-04be8bf30f0b of volume 7a5eb1f1-6032-4f52-a20b-f39474de5a30 {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:54:36 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be9e6a7-31d2-40ca-a403-d02e8f478ee2]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-02f45ea9-692d-4f84-9171-a5d8bdc53414 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:36 devstack sudo[85815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 Apr 21 20:54:36 devstack sudo[85815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:36 devstack sudo[85815]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-02f45ea9-692d-4f84-9171-a5d8bdc53414 tempest-VolumesDeleteCascade-1413170871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30" returned: 0 in 0.635s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-02f45ea9-692d-4f84-9171-a5d8bdc53414 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.afea2b6b-0225-4c4e-841f-04be8bf30f0b 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:36 devstack sudo[85826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.afea2b6b-0225-4c4e-841f-04be8bf30f0b 1G Apr 21 20:54:36 devstack sudo[85826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:37 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-82c46f0f-a7c0-4562-be54-4d5b37e01351 tempest-SnapshotMetadataTestJSON-980295510 None] Acquiring lock "cinder-09c9d9d0-e89c-4494-9f41-e52fd575f2ce-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:37 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-82c46f0f-a7c0-4562-be54-4d5b37e01351 tempest-SnapshotMetadataTestJSON-980295510 None] Lock "cinder-09c9d9d0-e89c-4494-9f41-e52fd575f2ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:37 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-82c46f0f-a7c0-4562-be54-4d5b37e01351 tempest-SnapshotMetadataTestJSON-980295510 None] Acquiring lock "cinder-quobyte-ebdcd526-ad56-40b0-863c-c91fe70d805b" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:37 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-82c46f0f-a7c0-4562-be54-4d5b37e01351 tempest-SnapshotMetadataTestJSON-980295510 None] Lock "cinder-quobyte-ebdcd526-ad56-40b0-863c-c91fe70d805b" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:37 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-82c46f0f-a7c0-4562-be54-4d5b37e01351 tempest-SnapshotMetadataTestJSON-980295510 None] Acquiring lock "cinder-quobyte-09c9d9d0-e89c-4494-9f41-e52fd575f2ce" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:37 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-82c46f0f-a7c0-4562-be54-4d5b37e01351 tempest-SnapshotMetadataTestJSON-980295510 None] Lock "cinder-quobyte-09c9d9d0-e89c-4494-9f41-e52fd575f2ce" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:37 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-82c46f0f-a7c0-4562-be54-4d5b37e01351 tempest-SnapshotMetadataTestJSON-980295510 None] Deleting offline snapshot 09c9d9d0-e89c-4494-9f41-e52fd575f2ce of volume ebdcd526-ad56-40b0-863c-c91fe70d805b {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:54:37 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-82c46f0f-a7c0-4562-be54-4d5b37e01351 tempest-SnapshotMetadataTestJSON-980295510 None] snapshot_file for this snap is: volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.09c9d9d0-e89c-4494-9f41-e52fd575f2ce {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:54:37 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[285fb973-ddc8-4f3a-ac18-d912a0bda744]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-82c46f0f-a7c0-4562-be54-4d5b37e01351 tempest-SnapshotMetadataTestJSON-980295510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.09c9d9d0-e89c-4494-9f41-e52fd575f2ce {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:37 devstack sudo[85831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.09c9d9d0-e89c-4494-9f41-e52fd575f2ce Apr 21 20:54:37 devstack sudo[85831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:37 devstack sudo[85826]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-02f45ea9-692d-4f84-9171-a5d8bdc53414 tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.afea2b6b-0225-4c4e-841f-04be8bf30f0b 1G" returned: 0 in 0.735s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-02f45ea9-692d-4f84-9171-a5d8bdc53414 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.afea2b6b-0225-4c4e-841f-04be8bf30f0b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:37 devstack sudo[85833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.afea2b6b-0225-4c4e-841f-04be8bf30f0b Apr 21 20:54:37 devstack sudo[85833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:38 devstack sudo[85831]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-82c46f0f-a7c0-4562-be54-4d5b37e01351 tempest-SnapshotMetadataTestJSON-980295510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.09c9d9d0-e89c-4494-9f41-e52fd575f2ce" returned: 0 in 0.549s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:38 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-82c46f0f-a7c0-4562-be54-4d5b37e01351 tempest-SnapshotMetadataTestJSON-980295510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebdcd526-ad56-40b0-863c-c91fe70d805b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:38 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f817d8d-1442-40d7-8a42-69e6a4478cb2]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-82c46f0f-a7c0-4562-be54-4d5b37e01351 tempest-SnapshotMetadataTestJSON-980295510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:38 devstack sudo[85833]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-02f45ea9-692d-4f84-9171-a5d8bdc53414 tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.afea2b6b-0225-4c4e-841f-04be8bf30f0b" returned: 0 in 0.500s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:38 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-02f45ea9-692d-4f84-9171-a5d8bdc53414 tempest-VolumesDeleteCascade-1413170871 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.afea2b6b-0225-4c4e-841f-04be8bf30f0b is being set with open permissions: ugo+rw Apr 21 20:54:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-02f45ea9-692d-4f84-9171-a5d8bdc53414 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.afea2b6b-0225-4c4e-841f-04be8bf30f0b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:38 devstack sudo[85841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b Apr 21 20:54:38 devstack sudo[85841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:38 devstack sudo[85842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.afea2b6b-0225-4c4e-841f-04be8bf30f0b Apr 21 20:54:38 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:38 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-02f45ea9-692d-4f84-9171-a5d8bdc53414 tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.afea2b6b-0225-4c4e-841f-04be8bf30f0b" returned: 0 in 0.433s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-02f45ea9-692d-4f84-9171-a5d8bdc53414 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:38 devstack sudo[85849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.info Apr 21 20:54:38 devstack sudo[85849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:38 devstack sudo[85841]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-82c46f0f-a7c0-4562-be54-4d5b37e01351 tempest-SnapshotMetadataTestJSON-980295510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b" returned: 0 in 0.589s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-82c46f0f-a7c0-4562-be54-4d5b37e01351 tempest-SnapshotMetadataTestJSON-980295510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.09c9d9d0-e89c-4494-9f41-e52fd575f2ce {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:38 devstack sudo[85851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.09c9d9d0-e89c-4494-9f41-e52fd575f2ce Apr 21 20:54:38 devstack sudo[85851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:39 devstack sudo[85849]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-02f45ea9-692d-4f84-9171-a5d8bdc53414 tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.info" returned: 0 in 0.491s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:39 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-02f45ea9-692d-4f84-9171-a5d8bdc53414 tempest-VolumesDeleteCascade-1413170871 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.info is being set with open permissions: ugo+rw Apr 21 20:54:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-02f45ea9-692d-4f84-9171-a5d8bdc53414 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:39 devstack sudo[85858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.info Apr 21 20:54:39 devstack sudo[85858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:39 devstack sudo[85851]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-82c46f0f-a7c0-4562-be54-4d5b37e01351 tempest-SnapshotMetadataTestJSON-980295510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.09c9d9d0-e89c-4494-9f41-e52fd575f2ce" returned: 0 in 0.502s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-82c46f0f-a7c0-4562-be54-4d5b37e01351 tempest-SnapshotMetadataTestJSON-980295510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.09c9d9d0-e89c-4494-9f41-e52fd575f2ce {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:39 devstack sudo[85860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.09c9d9d0-e89c-4494-9f41-e52fd575f2ce Apr 21 20:54:39 devstack sudo[85860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:39 devstack sudo[85858]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-02f45ea9-692d-4f84-9171-a5d8bdc53414 tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.info" returned: 0 in 0.512s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-02f45ea9-692d-4f84-9171-a5d8bdc53414 tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.428s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.395s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-422459437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad603fb8-3146-40ab-9298-881218afc8cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6c5c861705f42f98a18047ed7e7ff39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:36Z,use_quota=True,user_id='32f93bc4ed704fc1bba46695a26dd0e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Creating volume ad603fb8-3146-40ab-9298-881218afc8cd {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:39 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:54:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad603fb8-3146-40ab-9298-881218afc8cd 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:39 devstack sudo[85890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad603fb8-3146-40ab-9298-881218afc8cd 1073741824 Apr 21 20:54:39 devstack sudo[85890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:39 devstack sudo[85860]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-82c46f0f-a7c0-4562-be54-4d5b37e01351 tempest-SnapshotMetadataTestJSON-980295510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b.09c9d9d0-e89c-4494-9f41-e52fd575f2ce" returned: 0 in 0.552s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:39 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-02f45ea9-692d-4f84-9171-a5d8bdc53414 tempest-VolumesDeleteCascade-1413170871 None] Create snapshot completed successfully Apr 21 20:54:39 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-82c46f0f-a7c0-4562-be54-4d5b37e01351 tempest-SnapshotMetadataTestJSON-980295510 None] Lock "cinder-quobyte-09c9d9d0-e89c-4494-9f41-e52fd575f2ce" released by "_delete_snapshot" :: held 2.269s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:39 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-82c46f0f-a7c0-4562-be54-4d5b37e01351 tempest-SnapshotMetadataTestJSON-980295510 None] Lock "cinder-quobyte-ebdcd526-ad56-40b0-863c-c91fe70d805b" released by "delete_snapshot" :: held 2.286s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:39 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-82c46f0f-a7c0-4562-be54-4d5b37e01351 tempest-SnapshotMetadataTestJSON-980295510 None] Created reservations ['3509ee8a-ae6e-48ae-9a48-267570452108', '7a59bfc8-b1df-43c0-ac8e-b715cde1c5e2', 'a2d0f853-c0f4-4691-8bd6-09cfec25a187', 'ed918abe-162a-4bf8-8390-6296a6082625'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:39 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-82c46f0f-a7c0-4562-be54-4d5b37e01351 tempest-SnapshotMetadataTestJSON-980295510 None] Delete snapshot completed successfully. Apr 21 20:54:39 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-82c46f0f-a7c0-4562-be54-4d5b37e01351 tempest-SnapshotMetadataTestJSON-980295510 None] Lock "cinder-09c9d9d0-e89c-4494-9f41-e52fd575f2ce-delete_snapshot" released by "delete_snapshot" :: held 2.383s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:40 devstack sudo[85890]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad603fb8-3146-40ab-9298-881218afc8cd 1073741824" returned: 0 in 0.641s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad603fb8-3146-40ab-9298-881218afc8cd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:40 devstack sudo[85896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad603fb8-3146-40ab-9298-881218afc8cd Apr 21 20:54:40 devstack sudo[85896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Flow 'volume_create_manager' (d9c0dfad-c9d7-463d-b9a7-9c799ee5a923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6965872e-a926-446c-9d25-3847503e89d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6965872e-a926-446c-9d25-3847503e89d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1559465516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45145768-10ee-43e9-9bdf-afec3e69a73d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a67d0f6337040c486db592b492a5610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=afea2b6b-0225-4c4e-841f-04be8bf30f0b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:40Z,use_quota=True,user_id='c992c28659674ca08588f1f7bd2d2611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d116927-c6b3-49a9-a3f4-f42bbc3638f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d116927-c6b3-49a9-a3f4-f42bbc3638f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b813c6f-6429-44ed-9f14-42daccd3ab1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b813c6f-6429-44ed-9f14-42daccd3ab1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '45145768-10ee-43e9-9bdf-afec3e69a73d', 'volume_name': 'volume-45145768-10ee-43e9-9bdf-afec3e69a73d', 'volume_size': 1, 'snapshot_id': 'afea2b6b-0225-4c4e-841f-04be8bf30f0b'}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e6c790b-e40c-404c-85bb-c7b8271f9bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e6c790b-e40c-404c-85bb-c7b8271f9bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dac332b-ec25-47cc-8837-26727f5e7b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:40 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Volume 45145768-10ee-43e9-9bdf-afec3e69a73d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-45145768-10ee-43e9-9bdf-afec3e69a73d', 'volume_size': 1, 'snapshot_id': 'afea2b6b-0225-4c4e-841f-04be8bf30f0b'} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-92c94de8-698c-47aa-9430-4c601102686b tempest-SnapshotMetadataTestJSON-980295510 None] Acquiring lock "cinder-ebdcd526-ad56-40b0-863c-c91fe70d805b-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-92c94de8-698c-47aa-9430-4c601102686b tempest-SnapshotMetadataTestJSON-980295510 None] Lock "cinder-ebdcd526-ad56-40b0-863c-c91fe70d805b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-92c94de8-698c-47aa-9430-4c601102686b tempest-SnapshotMetadataTestJSON-980295510 None] Acquiring lock "cinder-quobyte-ebdcd526-ad56-40b0-863c-c91fe70d805b" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-92c94de8-698c-47aa-9430-4c601102686b tempest-SnapshotMetadataTestJSON-980295510 None] Lock "cinder-quobyte-ebdcd526-ad56-40b0-863c-c91fe70d805b" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e4d422-6cdd-42b1-881c-731163ad9d15]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-92c94de8-698c-47aa-9430-4c601102686b tempest-SnapshotMetadataTestJSON-980295510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:40 devstack sudo[85899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b Apr 21 20:54:40 devstack sudo[85899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:40 devstack sudo[85896]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad603fb8-3146-40ab-9298-881218afc8cd" returned: 0 in 0.567s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.394s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "cinder-quobyte-afea2b6b-0225-4c4e-841f-04be8bf30f0b-45145768-10ee-43e9-9bdf-afec3e69a73d" by "_create_volume_from_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f4350d-0d65-4e83-9fc4-67e988f4c966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad603fb8-3146-40ab-9298-881218afc8cd', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b797ac8a-784c-4f35-830c-4d21f771d1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-quobyte-afea2b6b-0225-4c4e-841f-04be8bf30f0b-45145768-10ee-43e9-9bdf-afec3e69a73d" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Creating volume 45145768-10ee-43e9-9bdf-afec3e69a73d from snapshot afea2b6b-0225-4c4e-841f-04be8bf30f0b {{(pid=81957) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "cinder-quobyte-45145768-10ee-43e9-9bdf-afec3e69a73d" by "_copy_volume_from_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:40 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Volume volume-ad603fb8-3146-40ab-9298-881218afc8cd (ad603fb8-3146-40ab-9298-881218afc8cd): created successfully Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b797ac8a-784c-4f35-830c-4d21f771d1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Flow 'volume_create_manager' (d90381dd-3ece-4c42-ad8d-0d29190935f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-quobyte-45145768-10ee-43e9-9bdf-afec3e69a73d" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] snapshot: afea2b6b-0225-4c4e-841f-04be8bf30f0b, volume: 45145768-10ee-43e9-9bdf-afec3e69a73d, {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:40 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-6fb36c4d-897a-4979-95e2-b1ced5aedaec tempest-VolumesTransfersV357Test-1818424115 None] Created volume successfully. Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c45f034-cb5b-4561-8ba5-7944fc017538]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.afea2b6b-0225-4c4e-841f-04be8bf30f0b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:41 devstack sudo[85901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.afea2b6b-0225-4c4e-841f-04be8bf30f0b Apr 21 20:54:41 devstack sudo[85901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:41 devstack sudo[85899]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-92c94de8-698c-47aa-9430-4c601102686b tempest-SnapshotMetadataTestJSON-980295510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b" returned: 0 in 0.532s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-92c94de8-698c-47aa-9430-4c601102686b tempest-SnapshotMetadataTestJSON-980295510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:41 devstack sudo[85919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b Apr 21 20:54:41 devstack sudo[85919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:41 devstack sudo[85901]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.afea2b6b-0225-4c4e-841f-04be8bf30f0b" returned: 0 in 0.600s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:41 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:41 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:54:41 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Creating direct copy from snapshot {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:54:41 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e1ec73-92c9-4ce5-9996-ebf6776d45a6]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:41 devstack sudo[85930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 Apr 21 20:54:41 devstack sudo[85930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:41 devstack sudo[85919]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-92c94de8-698c-47aa-9430-4c601102686b tempest-SnapshotMetadataTestJSON-980295510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ebdcd526-ad56-40b0-863c-c91fe70d805b" returned: 0 in 0.516s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:41 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-92c94de8-698c-47aa-9430-4c601102686b tempest-SnapshotMetadataTestJSON-980295510 None] Lock "cinder-quobyte-ebdcd526-ad56-40b0-863c-c91fe70d805b" released by "delete_volume" :: held 1.104s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:41 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-92c94de8-698c-47aa-9430-4c601102686b tempest-SnapshotMetadataTestJSON-980295510 None] Created reservations ['72032fc8-6ea9-481d-93d3-96286c9025c3', '53a56c41-7953-4943-8a7d-78ce5852be23', 'adc1ed7c-d99e-45b0-acc0-f25beed3e3e1', '8ddab553-c2ce-4f43-bb35-2080e1086d15'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:41 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-44b39feb-5038-45b0-ac73-3cb8b0c48f65 tempest-VolumesTransfersV357Test-1925323539 None] Transfer volume completed successfully. Apr 21 20:54:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-92c94de8-698c-47aa-9430-4c601102686b tempest-SnapshotMetadataTestJSON-980295510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-92c94de8-698c-47aa-9430-4c601102686b tempest-SnapshotMetadataTestJSON-980295510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:41 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-92c94de8-698c-47aa-9430-4c601102686b tempest-SnapshotMetadataTestJSON-980295510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:41 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-92c94de8-698c-47aa-9430-4c601102686b tempest-SnapshotMetadataTestJSON-980295510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-92c94de8-698c-47aa-9430-4c601102686b tempest-SnapshotMetadataTestJSON-980295510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-92c94de8-698c-47aa-9430-4c601102686b tempest-SnapshotMetadataTestJSON-980295510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:41 devstack sudo[85934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:54:41 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:42 devstack sudo[85930]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30" returned: 0 in 0.567s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:42 devstack cinder-volume[81957]: DEBUG cinder.utils [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Path /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-45145768-10ee-43e9-9bdf-afec3e69a73d not found in is_blk_device check {{(pid=81957) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:54:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-45145768-10ee-43e9-9bdf-afec3e69a73d {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:42 devstack sudo[85939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-45145768-10ee-43e9-9bdf-afec3e69a73d Apr 21 20:54:42 devstack sudo[85939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:42 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-92c94de8-698c-47aa-9430-4c601102686b tempest-SnapshotMetadataTestJSON-980295510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.458s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:42 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-92c94de8-698c-47aa-9430-4c601102686b tempest-SnapshotMetadataTestJSON-980295510 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:42 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-92c94de8-698c-47aa-9430-4c601102686b tempest-SnapshotMetadataTestJSON-980295510 None] Deleted volume successfully. Apr 21 20:54:42 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-92c94de8-698c-47aa-9430-4c601102686b tempest-SnapshotMetadataTestJSON-980295510 None] Lock "cinder-ebdcd526-ad56-40b0-863c-c91fe70d805b-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:42 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9206c847-daf8-4507-a733-7381ccea373b tempest-VolumesTransfersV357Test-1177774743 None] Acquiring lock "cinder-ad603fb8-3146-40ab-9298-881218afc8cd-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:42 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9206c847-daf8-4507-a733-7381ccea373b tempest-VolumesTransfersV357Test-1177774743 None] Lock "cinder-ad603fb8-3146-40ab-9298-881218afc8cd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9206c847-daf8-4507-a733-7381ccea373b tempest-VolumesTransfersV357Test-1177774743 None] Acquiring lock "cinder-quobyte-ad603fb8-3146-40ab-9298-881218afc8cd" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9206c847-daf8-4507-a733-7381ccea373b tempest-VolumesTransfersV357Test-1177774743 None] Lock "cinder-quobyte-ad603fb8-3146-40ab-9298-881218afc8cd" acquired by "delete_volume" :: waited 0.019s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:43 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[423aba41-c4ba-4f70-b06e-df481ddeb188]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9206c847-daf8-4507-a733-7381ccea373b tempest-VolumesTransfersV357Test-1177774743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad603fb8-3146-40ab-9298-881218afc8cd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:43 devstack sudo[85952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad603fb8-3146-40ab-9298-881218afc8cd Apr 21 20:54:43 devstack sudo[85952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:44 devstack sudo[85952]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9206c847-daf8-4507-a733-7381ccea373b tempest-VolumesTransfersV357Test-1177774743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad603fb8-3146-40ab-9298-881218afc8cd" returned: 0 in 1.504s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9206c847-daf8-4507-a733-7381ccea373b tempest-VolumesTransfersV357Test-1177774743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad603fb8-3146-40ab-9298-881218afc8cd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:44 devstack sudo[85958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad603fb8-3146-40ab-9298-881218afc8cd Apr 21 20:54:44 devstack sudo[85958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:44 devstack sudo[85939]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-45145768-10ee-43e9-9bdf-afec3e69a73d" returned: 0 in 2.526s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:44 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2356c4d-4197-42b4-a675-8f38a557deec]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:44 devstack sudo[85960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 Apr 21 20:54:44 devstack sudo[85960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:45 devstack sudo[85958]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9206c847-daf8-4507-a733-7381ccea373b tempest-VolumesTransfersV357Test-1177774743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ad603fb8-3146-40ab-9298-881218afc8cd" returned: 0 in 0.489s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9206c847-daf8-4507-a733-7381ccea373b tempest-VolumesTransfersV357Test-1177774743 None] Lock "cinder-quobyte-ad603fb8-3146-40ab-9298-881218afc8cd" released by "delete_volume" :: held 2.053s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-9206c847-daf8-4507-a733-7381ccea373b tempest-VolumesTransfersV357Test-1177774743 None] Created reservations ['6daa69af-7c39-45e1-99af-df37e3f14a26', '289c8b3c-6b4a-44f5-a152-2b69ef03f7cf', '2c4b8415-0527-4312-8451-4559291d6dbf', 'd93ac72c-25f3-4375-83a4-69d8293b7336'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9206c847-daf8-4507-a733-7381ccea373b tempest-VolumesTransfersV357Test-1177774743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9206c847-daf8-4507-a733-7381ccea373b tempest-VolumesTransfersV357Test-1177774743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9206c847-daf8-4507-a733-7381ccea373b tempest-VolumesTransfersV357Test-1177774743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9206c847-daf8-4507-a733-7381ccea373b tempest-VolumesTransfersV357Test-1177774743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9206c847-daf8-4507-a733-7381ccea373b tempest-VolumesTransfersV357Test-1177774743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9206c847-daf8-4507-a733-7381ccea373b tempest-VolumesTransfersV357Test-1177774743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:45 devstack sudo[85965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:54:45 devstack sudo[85965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:45 devstack sudo[85960]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30" returned: 0 in 0.793s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30, size 1024.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-45145768-10ee-43e9-9bdf-afec3e69a73d {{(pid=81957) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:54:45 devstack cinder-volume[81957]: INFO cinder.image.image_utils [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Converted 1024.00 MB image at 405.17 MB/s Apr 21 20:54:45 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-45145768-10ee-43e9-9bdf-afec3e69a73d is being set with open permissions: ugo+rw Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-45145768-10ee-43e9-9bdf-afec3e69a73d {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:45 devstack sudo[85968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-45145768-10ee-43e9-9bdf-afec3e69a73d Apr 21 20:54:45 devstack sudo[85968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Flow 'volume_create_manager' (4f8bfa44-26d1-4b1a-bdd4-f5558390e941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93464a1d-08c7-431c-8e44-fcf758305412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93464a1d-08c7-431c-8e44-fcf758305412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-770955099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3957658e-2b2f-4cf3-bdca-ca22b7bc63e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6c5c861705f42f98a18047ed7e7ff39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:46Z,use_quota=True,user_id='32f93bc4ed704fc1bba46695a26dd0e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c900d6-52ae-4ee2-b1cc-f22f757adcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c900d6-52ae-4ee2-b1cc-f22f757adcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f30d1431-c820-49e4-b120-306da5b52822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f30d1431-c820-49e4-b120-306da5b52822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3957658e-2b2f-4cf3-bdca-ca22b7bc63e1', 'volume_name': 'volume-3957658e-2b2f-4cf3-bdca-ca22b7bc63e1', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c31ea0-dbb0-4880-bba7-4d71f3290baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c31ea0-dbb0-4880-bba7-4d71f3290baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c66e344-e499-4980-960c-ab97dfb093ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:45 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Volume 3957658e-2b2f-4cf3-bdca-ca22b7bc63e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3957658e-2b2f-4cf3-bdca-ca22b7bc63e1', 'volume_size': 1} Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:45 devstack sudo[85965]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9206c847-daf8-4507-a733-7381ccea373b tempest-VolumesTransfersV357Test-1177774743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.771s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:45 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-9206c847-daf8-4507-a733-7381ccea373b tempest-VolumesTransfersV357Test-1177774743 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:45 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-9206c847-daf8-4507-a733-7381ccea373b tempest-VolumesTransfersV357Test-1177774743 None] Deleted volume successfully. Apr 21 20:54:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9206c847-daf8-4507-a733-7381ccea373b tempest-VolumesTransfersV357Test-1177774743 None] Lock "cinder-ad603fb8-3146-40ab-9298-881218afc8cd-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:46 devstack sudo[85968]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-45145768-10ee-43e9-9bdf-afec3e69a73d" returned: 0 in 0.663s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-quobyte-45145768-10ee-43e9-9bdf-afec3e69a73d" released by "_copy_volume_from_snapshot" :: held 5.216s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-quobyte-afea2b6b-0225-4c4e-841f-04be8bf30f0b-45145768-10ee-43e9-9bdf-afec3e69a73d" released by "_create_volume_from_snapshot" :: held 5.262s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.291s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.303s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-770955099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3957658e-2b2f-4cf3-bdca-ca22b7bc63e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6c5c861705f42f98a18047ed7e7ff39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:46Z,use_quota=True,user_id='32f93bc4ed704fc1bba46695a26dd0e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Creating volume 3957658e-2b2f-4cf3-bdca-ca22b7bc63e1 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:46 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:54:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3957658e-2b2f-4cf3-bdca-ca22b7bc63e1 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:46 devstack sudo[85999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3957658e-2b2f-4cf3-bdca-ca22b7bc63e1 1073741824 Apr 21 20:54:46 devstack sudo[85999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dac332b-ec25-47cc-8837-26727f5e7b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45145768-10ee-43e9-9bdf-afec3e69a73d', 'volume_size': 1, 'snapshot_id': 'afea2b6b-0225-4c4e-841f-04be8bf30f0b'}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0280e8-a833-4499-bd4d-d8a3e21093d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:46 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Volume volume-45145768-10ee-43e9-9bdf-afec3e69a73d (45145768-10ee-43e9-9bdf-afec3e69a73d): created successfully Apr 21 20:54:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0280e8-a833-4499-bd4d-d8a3e21093d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Flow 'volume_create_manager' (d9c0dfad-c9d7-463d-b9a7-9c799ee5a923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:46 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-7676932e-ebc4-436d-b3ba-8f8ad87590ba tempest-VolumesDeleteCascade-1413170871 None] Created volume successfully. Apr 21 20:54:47 devstack sudo[85999]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "cinder-7a5eb1f1-6032-4f52-a20b-f39474de5a30-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3957658e-2b2f-4cf3-bdca-ca22b7bc63e1 1073741824" returned: 0 in 0.953s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-7a5eb1f1-6032-4f52-a20b-f39474de5a30-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3957658e-2b2f-4cf3-bdca-ca22b7bc63e1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:47 devstack sudo[86006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3957658e-2b2f-4cf3-bdca-ca22b7bc63e1 Apr 21 20:54:47 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:47 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Performing cascade delete. {{(pid=81957) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 21 20:54:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "cinder-afea2b6b-0225-4c4e-841f-04be8bf30f0b-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-afea2b6b-0225-4c4e-841f-04be8bf30f0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "cinder-quobyte-7a5eb1f1-6032-4f52-a20b-f39474de5a30" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-quobyte-7a5eb1f1-6032-4f52-a20b-f39474de5a30" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "cinder-quobyte-afea2b6b-0225-4c4e-841f-04be8bf30f0b" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-quobyte-afea2b6b-0225-4c4e-841f-04be8bf30f0b" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Deleting offline snapshot afea2b6b-0225-4c4e-841f-04be8bf30f0b of volume 7a5eb1f1-6032-4f52-a20b-f39474de5a30 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:54:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] snapshot_file for this snap is: volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.afea2b6b-0225-4c4e-841f-04be8bf30f0b {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:54:47 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[1759e67e-67a1-4fd6-9a39-3856fa064a43]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.afea2b6b-0225-4c4e-841f-04be8bf30f0b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:47 devstack sudo[86008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.afea2b6b-0225-4c4e-841f-04be8bf30f0b Apr 21 20:54:47 devstack sudo[86008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:47 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3957658e-2b2f-4cf3-bdca-ca22b7bc63e1" returned: 0 in 0.654s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:47 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c66e344-e499-4980-960c-ab97dfb093ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3957658e-2b2f-4cf3-bdca-ca22b7bc63e1', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:47 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca518d21-3db9-4039-b8c7-dbf2959a5571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:47 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Volume volume-3957658e-2b2f-4cf3-bdca-ca22b7bc63e1 (3957658e-2b2f-4cf3-bdca-ca22b7bc63e1): created successfully Apr 21 20:54:47 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca518d21-3db9-4039-b8c7-dbf2959a5571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:47 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Flow 'volume_create_manager' (4f8bfa44-26d1-4b1a-bdd4-f5558390e941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:47 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-49cf02a0-c9a8-4ed6-8044-7722160ab722 tempest-VolumesTransfersV357Test-1818424115 None] Created volume successfully. Apr 21 20:54:48 devstack sudo[86008]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.afea2b6b-0225-4c4e-841f-04be8bf30f0b" returned: 0 in 0.659s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:48 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:48 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b27e2e-257b-4c30-b2f8-dc4c9ce264f0]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:48 devstack sudo[86015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 Apr 21 20:54:48 devstack sudo[86015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:49 devstack sudo[86015]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30" returned: 0 in 1.051s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.afea2b6b-0225-4c4e-841f-04be8bf30f0b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:49 devstack sudo[86040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.afea2b6b-0225-4c4e-841f-04be8bf30f0b Apr 21 20:54:49 devstack sudo[86040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-89229122-c71a-4baa-a750-7ee9e8d5ae15 tempest-VolumesTransfersV357Test-1177774743 None] Acquiring lock "cinder-3957658e-2b2f-4cf3-bdca-ca22b7bc63e1-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-89229122-c71a-4baa-a750-7ee9e8d5ae15 tempest-VolumesTransfersV357Test-1177774743 None] Lock "cinder-3957658e-2b2f-4cf3-bdca-ca22b7bc63e1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-89229122-c71a-4baa-a750-7ee9e8d5ae15 tempest-VolumesTransfersV357Test-1177774743 None] Acquiring lock "cinder-quobyte-3957658e-2b2f-4cf3-bdca-ca22b7bc63e1" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-89229122-c71a-4baa-a750-7ee9e8d5ae15 tempest-VolumesTransfersV357Test-1177774743 None] Lock "cinder-quobyte-3957658e-2b2f-4cf3-bdca-ca22b7bc63e1" acquired by "delete_volume" :: waited 0.017s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acd51c8-4c1c-4474-a228-1a675168b1b2]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-89229122-c71a-4baa-a750-7ee9e8d5ae15 tempest-VolumesTransfersV357Test-1177774743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3957658e-2b2f-4cf3-bdca-ca22b7bc63e1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:49 devstack sudo[86042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3957658e-2b2f-4cf3-bdca-ca22b7bc63e1 Apr 21 20:54:49 devstack sudo[86042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Flow 'volume_create_manager' (eda3e3ef-e9f0-4f92-bb1a-c6ac2a0ae682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c9136f-fbcd-4e76-9f24-2c63baddab1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c9136f-fbcd-4e76-9f24-2c63baddab1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-246191855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcc42180-c567-4e8c-aa31-143d40b16ef6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7fd7f4c9f2014ece88dbefe06f4de7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:49Z,use_quota=True,user_id='39b152c9eef64ab98893d1863ecbf07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481d1e11-9b6c-4909-8c7e-e310bc4bae94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481d1e11-9b6c-4909-8c7e-e310bc4bae94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d095c2-5597-4454-acd1-2c1e234ec88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d095c2-5597-4454-acd1-2c1e234ec88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcc42180-c567-4e8c-aa31-143d40b16ef6', 'volume_name': 'volume-fcc42180-c567-4e8c-aa31-143d40b16ef6', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ecbe6b5-1147-47c1-b9d6-66d6b2a4d22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ecbe6b5-1147-47c1-b9d6-66d6b2a4d22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62571051-5ae3-4595-af47-3f27266a6669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:49 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Volume fcc42180-c567-4e8c-aa31-143d40b16ef6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcc42180-c567-4e8c-aa31-143d40b16ef6', 'volume_size': 1} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-246191855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcc42180-c567-4e8c-aa31-143d40b16ef6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7fd7f4c9f2014ece88dbefe06f4de7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:49Z,use_quota=True,user_id='39b152c9eef64ab98893d1863ecbf07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Creating volume fcc42180-c567-4e8c-aa31-143d40b16ef6 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:49 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fcc42180-c567-4e8c-aa31-143d40b16ef6 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:49 devstack sudo[86047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fcc42180-c567-4e8c-aa31-143d40b16ef6 1073741824 Apr 21 20:54:49 devstack sudo[86047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:49 devstack sudo[86040]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.afea2b6b-0225-4c4e-841f-04be8bf30f0b" returned: 0 in 0.665s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.afea2b6b-0225-4c4e-841f-04be8bf30f0b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:49 devstack sudo[86055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.afea2b6b-0225-4c4e-841f-04be8bf30f0b Apr 21 20:54:49 devstack sudo[86055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:50 devstack sudo[86042]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-89229122-c71a-4baa-a750-7ee9e8d5ae15 tempest-VolumesTransfersV357Test-1177774743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3957658e-2b2f-4cf3-bdca-ca22b7bc63e1" returned: 0 in 0.708s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-89229122-c71a-4baa-a750-7ee9e8d5ae15 tempest-VolumesTransfersV357Test-1177774743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3957658e-2b2f-4cf3-bdca-ca22b7bc63e1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:50 devstack sudo[86081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3957658e-2b2f-4cf3-bdca-ca22b7bc63e1 Apr 21 20:54:50 devstack sudo[86081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:50 devstack sudo[86047]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fcc42180-c567-4e8c-aa31-143d40b16ef6 1073741824" returned: 0 in 0.884s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:50 devstack sudo[86055]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30.afea2b6b-0225-4c4e-841f-04be8bf30f0b" returned: 0 in 0.789s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:50 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-quobyte-afea2b6b-0225-4c4e-841f-04be8bf30f0b" released by "_delete_snapshot" :: held 3.273s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:50 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-quobyte-7a5eb1f1-6032-4f52-a20b-f39474de5a30" released by "delete_snapshot" :: held 3.297s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fcc42180-c567-4e8c-aa31-143d40b16ef6 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:50 devstack sudo[86109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fcc42180-c567-4e8c-aa31-143d40b16ef6 Apr 21 20:54:50 devstack sudo[86109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:50 devstack sudo[86081]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-89229122-c71a-4baa-a750-7ee9e8d5ae15 tempest-VolumesTransfersV357Test-1177774743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3957658e-2b2f-4cf3-bdca-ca22b7bc63e1" returned: 0 in 0.678s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:50 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Created reservations ['f7f01fec-99ee-4915-833e-54f39bbabe6b', '00229614-fec0-4d26-9b4f-ecdd94af9c71', 'd4d57354-343e-44f5-a96f-817e2bf0fb05', '89fcc38f-0b91-4c72-ad05-72f853183d2d'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:50 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-89229122-c71a-4baa-a750-7ee9e8d5ae15 tempest-VolumesTransfersV357Test-1177774743 None] Lock "cinder-quobyte-3957658e-2b2f-4cf3-bdca-ca22b7bc63e1" released by "delete_volume" :: held 1.428s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:50 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Delete snapshot completed successfully. Apr 21 20:54:50 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-afea2b6b-0225-4c4e-841f-04be8bf30f0b-delete_snapshot" released by "delete_snapshot" :: held 3.515s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:50 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Snapshots deleted, issuing volume delete {{(pid=81957) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 21 20:54:50 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "cinder-quobyte-7a5eb1f1-6032-4f52-a20b-f39474de5a30" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:50 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-quobyte-7a5eb1f1-6032-4f52-a20b-f39474de5a30" acquired by "delete_volume" :: waited 0.016s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:50 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-89229122-c71a-4baa-a750-7ee9e8d5ae15 tempest-VolumesTransfersV357Test-1177774743 None] Created reservations ['49c1daea-8d42-4346-86a6-ddbd2c8beda5', 'e93190d5-86a8-4d08-b118-5a7f2a928c93', '3acbb840-0ee8-4d31-b7c1-c76932c6f84b', 'c2bb009e-e9b5-4d00-925c-0843a14588c4'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:50 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd31658f-c58a-4c32-8708-81508132b048]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-89229122-c71a-4baa-a750-7ee9e8d5ae15 tempest-VolumesTransfersV357Test-1177774743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-89229122-c71a-4baa-a750-7ee9e8d5ae15 tempest-VolumesTransfersV357Test-1177774743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:50 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-89229122-c71a-4baa-a750-7ee9e8d5ae15 tempest-VolumesTransfersV357Test-1177774743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:50 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-89229122-c71a-4baa-a750-7ee9e8d5ae15 tempest-VolumesTransfersV357Test-1177774743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-89229122-c71a-4baa-a750-7ee9e8d5ae15 tempest-VolumesTransfersV357Test-1177774743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-89229122-c71a-4baa-a750-7ee9e8d5ae15 tempest-VolumesTransfersV357Test-1177774743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:50 devstack sudo[86113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 Apr 21 20:54:50 devstack sudo[86113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:50 devstack sudo[86114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:54:50 devstack sudo[86114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:51 devstack sudo[86109]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fcc42180-c567-4e8c-aa31-143d40b16ef6" returned: 0 in 0.601s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:51 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:51 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62571051-5ae3-4595-af47-3f27266a6669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcc42180-c567-4e8c-aa31-143d40b16ef6', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:51 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d208b1e-6a3a-473c-a931-ad5b3f8f6c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:51 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Volume volume-fcc42180-c567-4e8c-aa31-143d40b16ef6 (fcc42180-c567-4e8c-aa31-143d40b16ef6): created successfully Apr 21 20:54:51 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d208b1e-6a3a-473c-a931-ad5b3f8f6c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:51 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Flow 'volume_create_manager' (eda3e3ef-e9f0-4f92-bb1a-c6ac2a0ae682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:51 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-410eb57a-0056-4732-ae4c-1ac49142b747 tempest-VolumesListTestJSON-1171036989 None] Created volume successfully. Apr 21 20:54:51 devstack sudo[86114]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-89229122-c71a-4baa-a750-7ee9e8d5ae15 tempest-VolumesTransfersV357Test-1177774743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.561s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:51 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-89229122-c71a-4baa-a750-7ee9e8d5ae15 tempest-VolumesTransfersV357Test-1177774743 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:51 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-89229122-c71a-4baa-a750-7ee9e8d5ae15 tempest-VolumesTransfersV357Test-1177774743 None] Deleted volume successfully. Apr 21 20:54:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-89229122-c71a-4baa-a750-7ee9e8d5ae15 tempest-VolumesTransfersV357Test-1177774743 None] Lock "cinder-3957658e-2b2f-4cf3-bdca-ca22b7bc63e1-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:51 devstack sudo[86113]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30" returned: 0 in 0.765s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:51 devstack sudo[86123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30 Apr 21 20:54:51 devstack sudo[86123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Flow 'volume_create_manager' (e169b982-b0a6-42fc-90b6-1ef882d46e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2a4a6f-ca13-4dbc-af99-a3ef74a7ce71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2a4a6f-ca13-4dbc-af99-a3ef74a7ce71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2065024431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02963b6-be05-473f-99bb-3451c02b031f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7fd7f4c9f2014ece88dbefe06f4de7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:52Z,use_quota=True,user_id='39b152c9eef64ab98893d1863ecbf07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed26340-d2c1-48ae-bd80-b75565dac920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed26340-d2c1-48ae-bd80-b75565dac920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff761793-7bc4-49af-8cf9-eec94afe3339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff761793-7bc4-49af-8cf9-eec94afe3339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f02963b6-be05-473f-99bb-3451c02b031f', 'volume_name': 'volume-f02963b6-be05-473f-99bb-3451c02b031f', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a63c9e8-102e-48bb-b677-6a019f675904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a63c9e8-102e-48bb-b677-6a019f675904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:52 devstack sudo[86123]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb2dbd4e-d7d0-4ee2-83fd-4af94f8f0924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:52 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Volume f02963b6-be05-473f-99bb-3451c02b031f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f02963b6-be05-473f-99bb-3451c02b031f', 'volume_size': 1} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2065024431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02963b6-be05-473f-99bb-3451c02b031f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7fd7f4c9f2014ece88dbefe06f4de7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:52Z,use_quota=True,user_id='39b152c9eef64ab98893d1863ecbf07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Creating volume f02963b6-be05-473f-99bb-3451c02b031f {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:52 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f02963b6-be05-473f-99bb-3451c02b031f 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7a5eb1f1-6032-4f52-a20b-f39474de5a30" returned: 0 in 0.589s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:52 devstack sudo[86127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f02963b6-be05-473f-99bb-3451c02b031f 1073741824 Apr 21 20:54:52 devstack sudo[86127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-quobyte-7a5eb1f1-6032-4f52-a20b-f39474de5a30" released by "delete_volume" :: held 1.428s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Created reservations ['936c9881-2dfd-43d9-91ed-47f9da76af25', '9b165329-b46b-4119-a651-418ee25e29dc', 'eba3c358-36a3-4422-925f-787fe9d093e0', '75fc27fd-1274-4a69-a26a-e07b99eaa69d'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:52 devstack sudo[86130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:54:52 devstack sudo[86130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b1761f2e-1274-4303-9899-70ad950cb884 tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "cinder-45145768-10ee-43e9-9bdf-afec3e69a73d-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b1761f2e-1274-4303-9899-70ad950cb884 tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-45145768-10ee-43e9-9bdf-afec3e69a73d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:53 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b1761f2e-1274-4303-9899-70ad950cb884 tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "cinder-quobyte-45145768-10ee-43e9-9bdf-afec3e69a73d" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:53 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b1761f2e-1274-4303-9899-70ad950cb884 tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-quobyte-45145768-10ee-43e9-9bdf-afec3e69a73d" acquired by "delete_volume" :: waited 0.014s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:53 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[112a25fb-1663-4b1a-a276-20675d7c3ae9]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b1761f2e-1274-4303-9899-70ad950cb884 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-45145768-10ee-43e9-9bdf-afec3e69a73d {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:53 devstack sudo[86130]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.780s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:53 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:53 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Deleted volume successfully. Apr 21 20:54:53 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-fe69e236-c9eb-4874-8ee8-f6737c30ab2f tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-7a5eb1f1-6032-4f52-a20b-f39474de5a30-delete_volume" released by "delete_volume" :: held 5.978s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:53 devstack sudo[86137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-45145768-10ee-43e9-9bdf-afec3e69a73d Apr 21 20:54:53 devstack sudo[86137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:53 devstack sudo[86127]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f02963b6-be05-473f-99bb-3451c02b031f 1073741824" returned: 0 in 1.238s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f02963b6-be05-473f-99bb-3451c02b031f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:53 devstack sudo[86139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f02963b6-be05-473f-99bb-3451c02b031f Apr 21 20:54:53 devstack sudo[86139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:53 devstack sudo[86137]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:53 devstack cinder-volume[81957]: DEBUG oslo_service.periodic_task [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81957) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:54:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b1761f2e-1274-4303-9899-70ad950cb884 tempest-VolumesDeleteCascade-1413170871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-45145768-10ee-43e9-9bdf-afec3e69a73d" returned: 0 in 0.768s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b1761f2e-1274-4303-9899-70ad950cb884 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-45145768-10ee-43e9-9bdf-afec3e69a73d {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:53 devstack sudo[86144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:54:53 devstack sudo[86144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:53 devstack sudo[86145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-45145768-10ee-43e9-9bdf-afec3e69a73d Apr 21 20:54:53 devstack sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:54 devstack sudo[86139]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f02963b6-be05-473f-99bb-3451c02b031f" returned: 0 in 0.697s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:54 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:54 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb2dbd4e-d7d0-4ee2-83fd-4af94f8f0924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f02963b6-be05-473f-99bb-3451c02b031f', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:54 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5759a0f5-ccd1-415b-86ce-9ecf54e58b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:54 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Volume volume-f02963b6-be05-473f-99bb-3451c02b031f (f02963b6-be05-473f-99bb-3451c02b031f): created successfully Apr 21 20:54:54 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5759a0f5-ccd1-415b-86ce-9ecf54e58b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:54 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Flow 'volume_create_manager' (e169b982-b0a6-42fc-90b6-1ef882d46e8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:54 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-483d0480-c44b-49be-94cc-0156d4ecd23d tempest-VolumesListTestJSON-1171036989 None] Created volume successfully. Apr 21 20:54:54 devstack sudo[86145]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b1761f2e-1274-4303-9899-70ad950cb884 tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-45145768-10ee-43e9-9bdf-afec3e69a73d" returned: 0 in 0.671s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:54 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b1761f2e-1274-4303-9899-70ad950cb884 tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-quobyte-45145768-10ee-43e9-9bdf-afec3e69a73d" released by "delete_volume" :: held 1.470s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:54 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-b1761f2e-1274-4303-9899-70ad950cb884 tempest-VolumesDeleteCascade-1413170871 None] Created reservations ['04d225f7-8f03-4808-95c6-558d1f20365c', 'c954a9f6-f74e-47ee-abdb-b6e1e08a8ee9', '5dda5ac4-c614-47ff-b826-5e841e841d9a', 'f9463e9d-9b12-4723-9242-4321c1a424b2'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:54 devstack sudo[86144]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.745s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:54 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b1761f2e-1274-4303-9899-70ad950cb884 tempest-VolumesDeleteCascade-1413170871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b1761f2e-1274-4303-9899-70ad950cb884 tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:54 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b1761f2e-1274-4303-9899-70ad950cb884 tempest-VolumesDeleteCascade-1413170871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:54 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b1761f2e-1274-4303-9899-70ad950cb884 tempest-VolumesDeleteCascade-1413170871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b1761f2e-1274-4303-9899-70ad950cb884 tempest-VolumesDeleteCascade-1413170871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b1761f2e-1274-4303-9899-70ad950cb884 tempest-VolumesDeleteCascade-1413170871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:54 devstack sudo[86175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:54:54 devstack sudo[86175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:55 devstack sudo[86175]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b1761f2e-1274-4303-9899-70ad950cb884 tempest-VolumesDeleteCascade-1413170871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.519s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-b1761f2e-1274-4303-9899-70ad950cb884 tempest-VolumesDeleteCascade-1413170871 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:55 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-b1761f2e-1274-4303-9899-70ad950cb884 tempest-VolumesDeleteCascade-1413170871 None] Deleted volume successfully. Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b1761f2e-1274-4303-9899-70ad950cb884 tempest-VolumesDeleteCascade-1413170871 None] Lock "cinder-45145768-10ee-43e9-9bdf-afec3e69a73d-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Flow 'volume_create_manager' (1b0ea444-ca5a-4adc-b99c-559561c8200b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1c8392-b436-48de-858c-c5f3e6a0ed77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1c8392-b436-48de-858c-c5f3e6a0ed77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1712040346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82c9acda-8d2e-489f-9e11-97856b45bb58,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7fd7f4c9f2014ece88dbefe06f4de7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:56Z,use_quota=True,user_id='39b152c9eef64ab98893d1863ecbf07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1079416-2ae3-4b70-95af-50d05c6f95b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1079416-2ae3-4b70-95af-50d05c6f95b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405d52de-3a5f-49dd-ad07-177a03d8c49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405d52de-3a5f-49dd-ad07-177a03d8c49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82c9acda-8d2e-489f-9e11-97856b45bb58', 'volume_name': 'volume-82c9acda-8d2e-489f-9e11-97856b45bb58', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad615a0-3f91-40f7-a478-e109db692642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad615a0-3f91-40f7-a478-e109db692642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a4a9138-cdd0-456d-b485-9e3861c7563f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:55 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Volume 82c9acda-8d2e-489f-9e11-97856b45bb58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82c9acda-8d2e-489f-9e11-97856b45bb58', 'volume_size': 1} Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1712040346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82c9acda-8d2e-489f-9e11-97856b45bb58,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7fd7f4c9f2014ece88dbefe06f4de7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:56Z,use_quota=True,user_id='39b152c9eef64ab98893d1863ecbf07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Creating volume 82c9acda-8d2e-489f-9e11-97856b45bb58 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:55 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:54:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82c9acda-8d2e-489f-9e11-97856b45bb58 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:55 devstack sudo[86216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82c9acda-8d2e-489f-9e11-97856b45bb58 1073741824 Apr 21 20:54:55 devstack sudo[86216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:56 devstack sudo[86216]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82c9acda-8d2e-489f-9e11-97856b45bb58 1073741824" returned: 0 in 0.619s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82c9acda-8d2e-489f-9e11-97856b45bb58 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:56 devstack sudo[86223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82c9acda-8d2e-489f-9e11-97856b45bb58 Apr 21 20:54:56 devstack sudo[86223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Flow 'volume_create_manager' (ff04ed9f-103c-43dd-8914-304e22f8728a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065d827a-1528-425c-86d7-6e4018c58e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065d827a-1528-425c-86d7-6e4018c58e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-443858699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f3b26f0-529b-4fa7-a180-a7c31ff854ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cb3f57808b541f8b9e73b778fde559f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:57Z,use_quota=True,user_id='584cac22425a4bce9fa3bde5a4efc68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea0071b-4ea2-4cb6-adf5-b23b33c6c945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea0071b-4ea2-4cb6-adf5-b23b33c6c945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa177eb1-233a-4608-9404-0325f814a0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa177eb1-233a-4608-9404-0325f814a0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f3b26f0-529b-4fa7-a180-a7c31ff854ff', 'volume_name': 'volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e57641-a88d-4db3-b6cf-25afccf99114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e57641-a88d-4db3-b6cf-25afccf99114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6209e0bb-18db-4564-a760-3a85ab3e9474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:56 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Volume 2f3b26f0-529b-4fa7-a180-a7c31ff854ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff', 'volume_size': 1} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:56 devstack cinder-volume[81957]: INFO cinder.volume.manager [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-cb8429d1-ed0c-40c6-9ef8-6a369de5b8dd tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Terminate volume connection completed successfully. Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-cb8429d1-ed0c-40c6-9ef8-6a369de5b8dd tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Deleting attachment 283f0a93-f999-4791-a194-41f11343157c. {{(pid=81957) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 21 20:54:56 devstack sudo[86223]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82c9acda-8d2e-489f-9e11-97856b45bb58" returned: 0 in 0.443s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.271s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-443858699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f3b26f0-529b-4fa7-a180-a7c31ff854ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cb3f57808b541f8b9e73b778fde559f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:57Z,use_quota=True,user_id='584cac22425a4bce9fa3bde5a4efc68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Creating volume 2f3b26f0-529b-4fa7-a180-a7c31ff854ff {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:56 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a4a9138-cdd0-456d-b485-9e3861c7563f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82c9acda-8d2e-489f-9e11-97856b45bb58', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:56 devstack sudo[86226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff 1073741824 Apr 21 20:54:56 devstack sudo[86226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042f8a9d-d724-4d9f-9527-fda4186b4b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:56 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Volume volume-82c9acda-8d2e-489f-9e11-97856b45bb58 (82c9acda-8d2e-489f-9e11-97856b45bb58): created successfully Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042f8a9d-d724-4d9f-9527-fda4186b4b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Flow 'volume_create_manager' (1b0ea444-ca5a-4adc-b99c-559561c8200b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:56 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-19ef8748-0469-41c1-84ba-8aba0373edf4 tempest-VolumesListTestJSON-1171036989 None] Created volume successfully. Apr 21 20:54:57 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-b223ae0e-46d6-411c-8178-bb7ab4eda37a tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Acquiring lock "cinder-66f66f3b-e7da-404b-949d-6a317e298a52-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:57 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-b223ae0e-46d6-411c-8178-bb7ab4eda37a tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "cinder-66f66f3b-e7da-404b-949d-6a317e298a52-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:57 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-b223ae0e-46d6-411c-8178-bb7ab4eda37a tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Acquiring lock "cinder-quobyte-66f66f3b-e7da-404b-949d-6a317e298a52" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:57 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-b223ae0e-46d6-411c-8178-bb7ab4eda37a tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "cinder-quobyte-66f66f3b-e7da-404b-949d-6a317e298a52" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:57 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a067f63-474d-4c24-9de6-d3f257eef346]: (4, 'raw') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-b223ae0e-46d6-411c-8178-bb7ab4eda37a tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:57 devstack sudo[86226]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff 1073741824" returned: 0 in 0.647s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:57 devstack sudo[86232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff Apr 21 20:54:57 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:57 devstack sudo[86231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 Apr 21 20:54:57 devstack sudo[86231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:58 devstack sudo[86231]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-b223ae0e-46d6-411c-8178-bb7ab4eda37a tempest-ServerBootFromVolumeStableRescueTest-104892085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52" returned: 0 in 0.587s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-b223ae0e-46d6-411c-8178-bb7ab4eda37a tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:58 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff" returned: 0 in 0.553s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6209e0bb-18db-4564-a760-3a85ab3e9474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dec8cfa-242c-4999-9f22-629558ae1456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:58 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Volume volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff (2f3b26f0-529b-4fa7-a180-a7c31ff854ff): created successfully Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dec8cfa-242c-4999-9f22-629558ae1456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Flow 'volume_create_manager' (ff04ed9f-103c-43dd-8914-304e22f8728a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:58 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-fe1b1658-b988-49ab-9f30-7f1d04e7c132 tempest-VolumesCloneTest-1103554038 None] Created volume successfully. Apr 21 20:54:58 devstack sudo[86238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 Apr 21 20:54:58 devstack sudo[86238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Flow 'volume_create_manager' (9bda0488-1b61-4327-8a37-21ec5d59b62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb1cc0d-3216-4f3d-ac83-dc21a8a73578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb1cc0d-3216-4f3d-ac83-dc21a8a73578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-82541785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4315f1ab-e035-48ae-b5c7-f785c2258144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b23b28f54f4a5a9091cb2f07d8e517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:58Z,use_quota=True,user_id='0f538e84ea4c46278beb237b2ba42f47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ff32be-36f5-43a8-a99f-53173a4ba675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ff32be-36f5-43a8-a99f-53173a4ba675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93304d99-34d2-44e1-967b-ed66fd30796a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93304d99-34d2-44e1-967b-ed66fd30796a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4315f1ab-e035-48ae-b5c7-f785c2258144', 'volume_name': 'volume-4315f1ab-e035-48ae-b5c7-f785c2258144', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9edec6bd-8162-47c5-86bc-c180debdef46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9edec6bd-8162-47c5-86bc-c180debdef46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70e46c0-0722-428f-8bdc-913540a28384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:58 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Volume 4315f1ab-e035-48ae-b5c7-f785c2258144: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4315f1ab-e035-48ae-b5c7-f785c2258144', 'volume_size': 1} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-82541785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4315f1ab-e035-48ae-b5c7-f785c2258144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b23b28f54f4a5a9091cb2f07d8e517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:58Z,use_quota=True,user_id='0f538e84ea4c46278beb237b2ba42f47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Creating volume 4315f1ab-e035-48ae-b5c7-f785c2258144 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:58 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4315f1ab-e035-48ae-b5c7-f785c2258144 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:58 devstack sudo[86240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4315f1ab-e035-48ae-b5c7-f785c2258144 1073741824 Apr 21 20:54:58 devstack sudo[86240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:58 devstack sudo[86238]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-b223ae0e-46d6-411c-8178-bb7ab4eda37a tempest-ServerBootFromVolumeStableRescueTest-104892085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52" returned: 1 in 0.630s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-b223ae0e-46d6-411c-8178-bb7ab4eda37a tempest-ServerBootFromVolumeStableRescueTest-104892085 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52' failed. Not Retrying. {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:54:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-b223ae0e-46d6-411c-8178-bb7ab4eda37a tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:58 devstack sudo[86245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52 Apr 21 20:54:58 devstack sudo[86245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Flow 'volume_create_manager' (c3691a19-3572-4fec-9072-6cd4086da0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3bfe0c4-e7c9-4118-b40e-d09956f465e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3bfe0c4-e7c9-4118-b40e-d09956f465e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1234050699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=877ed380-430e-4635-8f5f-fd75d2bea361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cb3f57808b541f8b9e73b778fde559f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=2f3b26f0-529b-4fa7-a180-a7c31ff854ff,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:59Z,use_quota=True,user_id='584cac22425a4bce9fa3bde5a4efc68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d775a3-cfb7-4928-aea5-1305e4265e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d775a3-cfb7-4928-aea5-1305e4265e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b3ae22-46a8-4da5-a0d3-e1be124e3598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:59 devstack sudo[86240]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4315f1ab-e035-48ae-b5c7-f785c2258144 1073741824" returned: 0 in 0.596s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b3ae22-46a8-4da5-a0d3-e1be124e3598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '877ed380-430e-4635-8f5f-fd75d2bea361', 'volume_name': 'volume-877ed380-430e-4635-8f5f-fd75d2bea361', 'volume_size': 2, 'source_volid': '2f3b26f0-529b-4fa7-a180-a7c31ff854ff', 'source_volstatus': 'available'}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02adc04b-6a20-43b2-8f45-92f06bb7bd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02adc04b-6a20-43b2-8f45-92f06bb7bd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdffcba4-db83-4f85-9374-cc2749081610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:59 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Volume 877ed380-430e-4635-8f5f-fd75d2bea361: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-877ed380-430e-4635-8f5f-fd75d2bea361', 'volume_size': 2, 'source_volid': '2f3b26f0-529b-4fa7-a180-a7c31ff854ff', 'source_volstatus': 'available'} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4315f1ab-e035-48ae-b5c7-f785c2258144 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:59 devstack sudo[86251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4315f1ab-e035-48ae-b5c7-f785c2258144 Apr 21 20:54:59 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:59 devstack sudo[86245]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-b223ae0e-46d6-411c-8178-bb7ab4eda37a tempest-ServerBootFromVolumeStableRescueTest-104892085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-66f66f3b-e7da-404b-949d-6a317e298a52" returned: 0 in 0.514s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-b223ae0e-46d6-411c-8178-bb7ab4eda37a tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "cinder-quobyte-66f66f3b-e7da-404b-949d-6a317e298a52" released by "delete_volume" :: held 1.787s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.quota [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-b223ae0e-46d6-411c-8178-bb7ab4eda37a tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Created reservations ['bc6014a7-7143-4bec-8166-5283e082fa52', '46b4a72b-5e42-49ca-a56f-34e52a74a070', 'b4cad47a-105d-4b36-b9c0-6751e0ddd2b3', '268b631b-fbe7-416a-97c0-3de5460cdf5c'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-b223ae0e-46d6-411c-8178-bb7ab4eda37a tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-b223ae0e-46d6-411c-8178-bb7ab4eda37a tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-b223ae0e-46d6-411c-8178-bb7ab4eda37a tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-b223ae0e-46d6-411c-8178-bb7ab4eda37a tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-b223ae0e-46d6-411c-8178-bb7ab4eda37a tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-b223ae0e-46d6-411c-8178-bb7ab4eda37a tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:59 devstack sudo[86254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:54:59 devstack sudo[86254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:59 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4315f1ab-e035-48ae-b5c7-f785c2258144" returned: 0 in 0.501s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.520s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:59 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Cloning volume 2f3b26f0-529b-4fa7-a180-a7c31ff854ff to volume 877ed380-430e-4635-8f5f-fd75d2bea361 Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70e46c0-0722-428f-8bdc-913540a28384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4315f1ab-e035-48ae-b5c7-f785c2258144', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181fdc2f-8413-4999-bcd5-70142c5a197c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:59 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Volume volume-4315f1ab-e035-48ae-b5c7-f785c2258144 (4315f1ab-e035-48ae-b5c7-f785c2258144): created successfully Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181fdc2f-8413-4999-bcd5-70142c5a197c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Flow 'volume_create_manager' (9bda0488-1b61-4327-8a37-21ec5d59b62d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:59 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-d15e1082-7b60-4359-bcb7-49d807c206fe tempest-VolumesTransfersTest-1173686632 None] Created volume successfully. Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Creating offline snapshot fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51 of volume 2f3b26f0-529b-4fa7-a180-a7c31ff854ff {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[891710c6-3308-4b67-a70c-a82ac5095796]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:59 devstack sudo[86257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff Apr 21 20:54:59 devstack sudo[86257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5fe2ee76-84fa-42e4-b62b-c9a6d0504bc0 tempest-VolumesListTestJSON-1171036989 None] Acquiring lock "cinder-82c9acda-8d2e-489f-9e11-97856b45bb58-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5fe2ee76-84fa-42e4-b62b-c9a6d0504bc0 tempest-VolumesListTestJSON-1171036989 None] Lock "cinder-82c9acda-8d2e-489f-9e11-97856b45bb58-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:59 devstack sudo[86254]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5fe2ee76-84fa-42e4-b62b-c9a6d0504bc0 tempest-VolumesListTestJSON-1171036989 None] Acquiring lock "cinder-quobyte-82c9acda-8d2e-489f-9e11-97856b45bb58" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-b223ae0e-46d6-411c-8178-bb7ab4eda37a tempest-ServerBootFromVolumeStableRescueTest-104892085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.505s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.manager [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-b223ae0e-46d6-411c-8178-bb7ab4eda37a tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:59 devstack cinder-volume[81957]: INFO cinder.volume.manager [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-b223ae0e-46d6-411c-8178-bb7ab4eda37a tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Deleted volume successfully. Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5fe2ee76-84fa-42e4-b62b-c9a6d0504bc0 tempest-VolumesListTestJSON-1171036989 None] Lock "cinder-quobyte-82c9acda-8d2e-489f-9e11-97856b45bb58" acquired by "delete_volume" :: waited 0.015s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3da1ea-9c84-4475-b7f0-af8b0484303e]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5fe2ee76-84fa-42e4-b62b-c9a6d0504bc0 tempest-VolumesListTestJSON-1171036989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82c9acda-8d2e-489f-9e11-97856b45bb58 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:59 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-efb859b5-da3d-42c2-b35b-bef7612d09c4 req-b223ae0e-46d6-411c-8178-bb7ab4eda37a tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "cinder-66f66f3b-e7da-404b-949d-6a317e298a52-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:59 devstack sudo[86260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82c9acda-8d2e-489f-9e11-97856b45bb58 Apr 21 20:54:59 devstack sudo[86260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:00 devstack sudo[86257]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff" returned: 0 in 0.558s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:00 devstack sudo[86266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51 1G Apr 21 20:55:00 devstack sudo[86266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:00 devstack sudo[86260]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5fe2ee76-84fa-42e4-b62b-c9a6d0504bc0 tempest-VolumesListTestJSON-1171036989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82c9acda-8d2e-489f-9e11-97856b45bb58" returned: 0 in 0.485s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5fe2ee76-84fa-42e4-b62b-c9a6d0504bc0 tempest-VolumesListTestJSON-1171036989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82c9acda-8d2e-489f-9e11-97856b45bb58 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:00 devstack sudo[86270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82c9acda-8d2e-489f-9e11-97856b45bb58 Apr 21 20:55:00 devstack sudo[86270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:00 devstack sudo[86266]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51 1G" returned: 0 in 0.630s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:00 devstack sudo[86278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51 Apr 21 20:55:00 devstack sudo[86278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:00 devstack sudo[86270]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5fe2ee76-84fa-42e4-b62b-c9a6d0504bc0 tempest-VolumesListTestJSON-1171036989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-82c9acda-8d2e-489f-9e11-97856b45bb58" returned: 0 in 0.593s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:00 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5fe2ee76-84fa-42e4-b62b-c9a6d0504bc0 tempest-VolumesListTestJSON-1171036989 None] Lock "cinder-quobyte-82c9acda-8d2e-489f-9e11-97856b45bb58" released by "delete_volume" :: held 1.105s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:01 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-1378c3bf-414b-48ea-ab57-963f08649ca0 tempest-VolumesTransfersTest-1966810846 None] Transfer volume completed successfully. Apr 21 20:55:01 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-5fe2ee76-84fa-42e4-b62b-c9a6d0504bc0 tempest-VolumesListTestJSON-1171036989 None] Created reservations ['0fd120bb-a915-40e0-ae25-3a24c5dd2e4f', '50691e79-c390-4d9a-811a-6d2729f0064e', '94e53ed2-adc5-4bdb-8ae3-94725a21c5f4', '538b36fa-3782-4d54-9185-9de63a785809'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5fe2ee76-84fa-42e4-b62b-c9a6d0504bc0 tempest-VolumesListTestJSON-1171036989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5fe2ee76-84fa-42e4-b62b-c9a6d0504bc0 tempest-VolumesListTestJSON-1171036989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5fe2ee76-84fa-42e4-b62b-c9a6d0504bc0 tempest-VolumesListTestJSON-1171036989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5fe2ee76-84fa-42e4-b62b-c9a6d0504bc0 tempest-VolumesListTestJSON-1171036989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5fe2ee76-84fa-42e4-b62b-c9a6d0504bc0 tempest-VolumesListTestJSON-1171036989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5fe2ee76-84fa-42e4-b62b-c9a6d0504bc0 tempest-VolumesListTestJSON-1171036989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:01 devstack sudo[86280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:55:01 devstack sudo[86280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:01 devstack sudo[86278]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51" returned: 0 in 0.504s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:01 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51 is being set with open permissions: ugo+rw Apr 21 20:55:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:01 devstack sudo[86285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51 Apr 21 20:55:01 devstack sudo[86285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:01 devstack sudo[86280]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5fe2ee76-84fa-42e4-b62b-c9a6d0504bc0 tempest-VolumesListTestJSON-1171036989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.423s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:01 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-5fe2ee76-84fa-42e4-b62b-c9a6d0504bc0 tempest-VolumesListTestJSON-1171036989 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:01 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-5fe2ee76-84fa-42e4-b62b-c9a6d0504bc0 tempest-VolumesListTestJSON-1171036989 None] Deleted volume successfully. Apr 21 20:55:01 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5fe2ee76-84fa-42e4-b62b-c9a6d0504bc0 tempest-VolumesListTestJSON-1171036989 None] Lock "cinder-82c9acda-8d2e-489f-9e11-97856b45bb58-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:01 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ac6c2a6c-6403-416d-a885-7b9da44bf0d5 tempest-VolumesTransfersTest-449402766 None] Acquiring lock "cinder-4315f1ab-e035-48ae-b5c7-f785c2258144-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:01 devstack sudo[86285]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51" returned: 0 in 0.520s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:01 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ac6c2a6c-6403-416d-a885-7b9da44bf0d5 tempest-VolumesTransfersTest-449402766 None] Lock "cinder-4315f1ab-e035-48ae-b5c7-f785c2258144-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:02 devstack sudo[86425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.info Apr 21 20:55:02 devstack sudo[86425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ac6c2a6c-6403-416d-a885-7b9da44bf0d5 tempest-VolumesTransfersTest-449402766 None] Acquiring lock "cinder-quobyte-4315f1ab-e035-48ae-b5c7-f785c2258144" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ac6c2a6c-6403-416d-a885-7b9da44bf0d5 tempest-VolumesTransfersTest-449402766 None] Lock "cinder-quobyte-4315f1ab-e035-48ae-b5c7-f785c2258144" acquired by "delete_volume" :: waited 0.018s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:02 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4219798-1c91-404c-9c35-72cc521cde21]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ac6c2a6c-6403-416d-a885-7b9da44bf0d5 tempest-VolumesTransfersTest-449402766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4315f1ab-e035-48ae-b5c7-f785c2258144 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7b664df6-0008-4d45-bfaa-b105b6e5349e tempest-VolumesListTestJSON-1171036989 None] Acquiring lock "cinder-f02963b6-be05-473f-99bb-3451c02b031f-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7b664df6-0008-4d45-bfaa-b105b6e5349e tempest-VolumesListTestJSON-1171036989 None] Lock "cinder-f02963b6-be05-473f-99bb-3451c02b031f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7b664df6-0008-4d45-bfaa-b105b6e5349e tempest-VolumesListTestJSON-1171036989 None] Acquiring lock "cinder-quobyte-f02963b6-be05-473f-99bb-3451c02b031f" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7b664df6-0008-4d45-bfaa-b105b6e5349e tempest-VolumesListTestJSON-1171036989 None] Lock "cinder-quobyte-f02963b6-be05-473f-99bb-3451c02b031f" acquired by "delete_volume" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:02 devstack sudo[86459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4315f1ab-e035-48ae-b5c7-f785c2258144 Apr 21 20:55:02 devstack sudo[86459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:02 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe600ae-52c8-492e-bef8-7f929890a58f]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7b664df6-0008-4d45-bfaa-b105b6e5349e tempest-VolumesListTestJSON-1171036989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f02963b6-be05-473f-99bb-3451c02b031f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:02 devstack sudo[86461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f02963b6-be05-473f-99bb-3451c02b031f Apr 21 20:55:02 devstack sudo[86461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:02 devstack sudo[86425]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.info" returned: 0 in 0.581s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:02 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.info is being set with open permissions: ugo+rw Apr 21 20:55:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:02 devstack sudo[86465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.info Apr 21 20:55:02 devstack sudo[86465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:02 devstack sudo[86459]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ac6c2a6c-6403-416d-a885-7b9da44bf0d5 tempest-VolumesTransfersTest-449402766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4315f1ab-e035-48ae-b5c7-f785c2258144" returned: 0 in 0.625s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ac6c2a6c-6403-416d-a885-7b9da44bf0d5 tempest-VolumesTransfersTest-449402766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4315f1ab-e035-48ae-b5c7-f785c2258144 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:02 devstack sudo[86473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4315f1ab-e035-48ae-b5c7-f785c2258144 Apr 21 20:55:02 devstack sudo[86473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:02 devstack sudo[86461]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7b664df6-0008-4d45-bfaa-b105b6e5349e tempest-VolumesListTestJSON-1171036989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f02963b6-be05-473f-99bb-3451c02b031f" returned: 0 in 0.539s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7b664df6-0008-4d45-bfaa-b105b6e5349e tempest-VolumesListTestJSON-1171036989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f02963b6-be05-473f-99bb-3451c02b031f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:02 devstack sudo[86475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f02963b6-be05-473f-99bb-3451c02b031f Apr 21 20:55:02 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:02 devstack sudo[86465]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.info" returned: 0 in 0.424s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Acquiring lock "cinder-quobyte-877ed380-430e-4635-8f5f-fd75d2bea361" by "_copy_volume_from_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Lock "cinder-quobyte-877ed380-430e-4635-8f5f-fd75d2bea361" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:02 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] snapshot: fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51, volume: 877ed380-430e-4635-8f5f-fd75d2bea361, {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cc4020-845a-47e7-b9e8-b3182a89ca53]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:03 devstack sudo[86478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51 Apr 21 20:55:03 devstack sudo[86478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:03 devstack sudo[86473]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ac6c2a6c-6403-416d-a885-7b9da44bf0d5 tempest-VolumesTransfersTest-449402766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4315f1ab-e035-48ae-b5c7-f785c2258144" returned: 0 in 0.440s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ac6c2a6c-6403-416d-a885-7b9da44bf0d5 tempest-VolumesTransfersTest-449402766 None] Lock "cinder-quobyte-4315f1ab-e035-48ae-b5c7-f785c2258144" released by "delete_volume" :: held 1.106s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-ac6c2a6c-6403-416d-a885-7b9da44bf0d5 tempest-VolumesTransfersTest-449402766 None] Created reservations ['0cc874af-91b1-4fb5-af10-ce2f7d29e922', '0dee1818-0744-43a2-a996-79506993c04f', 'eb8560c4-5dfd-4b9c-af2e-c6318dd95309', 'b5324fc8-121d-40c3-8a20-7d355a0ab23e'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:03 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7b664df6-0008-4d45-bfaa-b105b6e5349e tempest-VolumesListTestJSON-1171036989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f02963b6-be05-473f-99bb-3451c02b031f" returned: 0 in 0.452s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7b664df6-0008-4d45-bfaa-b105b6e5349e tempest-VolumesListTestJSON-1171036989 None] Lock "cinder-quobyte-f02963b6-be05-473f-99bb-3451c02b031f" released by "delete_volume" :: held 1.022s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-7b664df6-0008-4d45-bfaa-b105b6e5349e tempest-VolumesListTestJSON-1171036989 None] Created reservations ['b896f27f-2cbb-48ae-8693-6dcdc68744b8', '7be79ffd-f006-4936-bfad-a9d6c729d7b3', '2559bb87-7bac-4750-90ae-cbd1c3433689', '445e77ff-e0a8-408d-a874-9d416ee0f283'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ac6c2a6c-6403-416d-a885-7b9da44bf0d5 tempest-VolumesTransfersTest-449402766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ac6c2a6c-6403-416d-a885-7b9da44bf0d5 tempest-VolumesTransfersTest-449402766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ac6c2a6c-6403-416d-a885-7b9da44bf0d5 tempest-VolumesTransfersTest-449402766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ac6c2a6c-6403-416d-a885-7b9da44bf0d5 tempest-VolumesTransfersTest-449402766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ac6c2a6c-6403-416d-a885-7b9da44bf0d5 tempest-VolumesTransfersTest-449402766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ac6c2a6c-6403-416d-a885-7b9da44bf0d5 tempest-VolumesTransfersTest-449402766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:03 devstack sudo[86483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:55:03 devstack sudo[86483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7b664df6-0008-4d45-bfaa-b105b6e5349e tempest-VolumesListTestJSON-1171036989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7b664df6-0008-4d45-bfaa-b105b6e5349e tempest-VolumesListTestJSON-1171036989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7b664df6-0008-4d45-bfaa-b105b6e5349e tempest-VolumesListTestJSON-1171036989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7b664df6-0008-4d45-bfaa-b105b6e5349e tempest-VolumesListTestJSON-1171036989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7b664df6-0008-4d45-bfaa-b105b6e5349e tempest-VolumesListTestJSON-1171036989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7b664df6-0008-4d45-bfaa-b105b6e5349e tempest-VolumesListTestJSON-1171036989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:03 devstack sudo[86485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:55:03 devstack sudo[86485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:03 devstack sudo[86478]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51" returned: 0 in 0.603s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Creating direct copy from snapshot {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47c567e-d0af-4189-bcb2-9b9e74397255]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:03 devstack sudo[86492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff Apr 21 20:55:03 devstack sudo[86492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:03 devstack sudo[86483]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ac6c2a6c-6403-416d-a885-7b9da44bf0d5 tempest-VolumesTransfersTest-449402766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.521s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-ac6c2a6c-6403-416d-a885-7b9da44bf0d5 tempest-VolumesTransfersTest-449402766 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:03 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-ac6c2a6c-6403-416d-a885-7b9da44bf0d5 tempest-VolumesTransfersTest-449402766 None] Deleted volume successfully. Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ac6c2a6c-6403-416d-a885-7b9da44bf0d5 tempest-VolumesTransfersTest-449402766 None] Lock "cinder-4315f1ab-e035-48ae-b5c7-f785c2258144-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:03 devstack sudo[86485]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7b664df6-0008-4d45-bfaa-b105b6e5349e tempest-VolumesListTestJSON-1171036989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.513s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-7b664df6-0008-4d45-bfaa-b105b6e5349e tempest-VolumesListTestJSON-1171036989 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:03 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-7b664df6-0008-4d45-bfaa-b105b6e5349e tempest-VolumesListTestJSON-1171036989 None] Deleted volume successfully. Apr 21 20:55:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7b664df6-0008-4d45-bfaa-b105b6e5349e tempest-VolumesListTestJSON-1171036989 None] Lock "cinder-f02963b6-be05-473f-99bb-3451c02b031f-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:04 devstack sudo[86492]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff" returned: 0 in 0.513s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:04 devstack cinder-volume[81957]: DEBUG cinder.utils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Path /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-877ed380-430e-4635-8f5f-fd75d2bea361 not found in is_blk_device check {{(pid=81957) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:55:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-877ed380-430e-4635-8f5f-fd75d2bea361 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:04 devstack sudo[86500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-877ed380-430e-4635-8f5f-fd75d2bea361 Apr 21 20:55:04 devstack sudo[86500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e32869ae-2462-4ef6-b4a3-17cee9bd4c46 tempest-VolumesListTestJSON-1171036989 None] Acquiring lock "cinder-fcc42180-c567-4e8c-aa31-143d40b16ef6-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:04 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Flow 'volume_create_manager' (d3068e76-0737-40f4-a7ab-ce964b231f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e27706-daf5-4759-bdfd-4832047a9981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e27706-daf5-4759-bdfd-4832047a9981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1011725155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5325b3f-9175-4945-ad8f-37988839699a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b23b28f54f4a5a9091cb2f07d8e517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:04Z,use_quota=True,user_id='0f538e84ea4c46278beb237b2ba42f47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b32b20-d9e1-42e9-9f86-9086892d3918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b32b20-d9e1-42e9-9f86-9086892d3918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ca43f7-511e-4d8e-b059-0a5bdbc75ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ca43f7-511e-4d8e-b059-0a5bdbc75ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5325b3f-9175-4945-ad8f-37988839699a', 'volume_name': 'volume-e5325b3f-9175-4945-ad8f-37988839699a', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521d2445-3b87-4910-ada2-77af95273ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521d2445-3b87-4910-ada2-77af95273ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72027350-1fd0-4516-b545-5f5412af96bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:04 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Volume e5325b3f-9175-4945-ad8f-37988839699a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5325b3f-9175-4945-ad8f-37988839699a', 'volume_size': 1} Apr 21 20:55:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e32869ae-2462-4ef6-b4a3-17cee9bd4c46 tempest-VolumesListTestJSON-1171036989 None] Lock "cinder-fcc42180-c567-4e8c-aa31-143d40b16ef6-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e32869ae-2462-4ef6-b4a3-17cee9bd4c46 tempest-VolumesListTestJSON-1171036989 None] Acquiring lock "cinder-quobyte-fcc42180-c567-4e8c-aa31-143d40b16ef6" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e32869ae-2462-4ef6-b4a3-17cee9bd4c46 tempest-VolumesListTestJSON-1171036989 None] Lock "cinder-quobyte-fcc42180-c567-4e8c-aa31-143d40b16ef6" acquired by "delete_volume" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:04 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[8113e519-3df9-4fc0-8f73-453ec9e4e6dd]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e32869ae-2462-4ef6-b4a3-17cee9bd4c46 tempest-VolumesListTestJSON-1171036989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fcc42180-c567-4e8c-aa31-143d40b16ef6 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:04 devstack sudo[86503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fcc42180-c567-4e8c-aa31-143d40b16ef6 Apr 21 20:55:04 devstack sudo[86503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:05 devstack sudo[86503]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e32869ae-2462-4ef6-b4a3-17cee9bd4c46 tempest-VolumesListTestJSON-1171036989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fcc42180-c567-4e8c-aa31-143d40b16ef6" returned: 0 in 1.367s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e32869ae-2462-4ef6-b4a3-17cee9bd4c46 tempest-VolumesListTestJSON-1171036989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fcc42180-c567-4e8c-aa31-143d40b16ef6 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:05 devstack sudo[86518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fcc42180-c567-4e8c-aa31-143d40b16ef6 Apr 21 20:55:05 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:06 devstack sudo[86500]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-877ed380-430e-4635-8f5f-fd75d2bea361" returned: 0 in 2.065s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:06 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fe69ae-b807-4ab0-84fc-e8b58b1f426b]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:06 devstack sudo[86520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff Apr 21 20:55:06 devstack sudo[86520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:06 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e32869ae-2462-4ef6-b4a3-17cee9bd4c46 tempest-VolumesListTestJSON-1171036989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fcc42180-c567-4e8c-aa31-143d40b16ef6" returned: 0 in 0.613s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:06 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e32869ae-2462-4ef6-b4a3-17cee9bd4c46 tempest-VolumesListTestJSON-1171036989 None] Lock "cinder-quobyte-fcc42180-c567-4e8c-aa31-143d40b16ef6" released by "delete_volume" :: held 2.002s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:06 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-e32869ae-2462-4ef6-b4a3-17cee9bd4c46 tempest-VolumesListTestJSON-1171036989 None] Created reservations ['44b2ea20-1a7d-4761-8463-9c0edd838637', 'cc1586db-8e15-4041-88d4-3d7ff308f164', 'eb6d6957-2d3a-4862-80bd-0bbeb7d0996e', '31db0089-b022-4aba-bd00-fe420ee49fc2'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e32869ae-2462-4ef6-b4a3-17cee9bd4c46 tempest-VolumesListTestJSON-1171036989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e32869ae-2462-4ef6-b4a3-17cee9bd4c46 tempest-VolumesListTestJSON-1171036989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e32869ae-2462-4ef6-b4a3-17cee9bd4c46 tempest-VolumesListTestJSON-1171036989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e32869ae-2462-4ef6-b4a3-17cee9bd4c46 tempest-VolumesListTestJSON-1171036989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e32869ae-2462-4ef6-b4a3-17cee9bd4c46 tempest-VolumesListTestJSON-1171036989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e32869ae-2462-4ef6-b4a3-17cee9bd4c46 tempest-VolumesListTestJSON-1171036989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:06 devstack sudo[86523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:55:06 devstack sudo[86523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:06 devstack sudo[86520]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff" returned: 0 in 0.654s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:06 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff, size 1024.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-877ed380-430e-4635-8f5f-fd75d2bea361 {{(pid=81957) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:55:06 devstack cinder-volume[81957]: INFO cinder.image.image_utils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Converted 1024.00 MB image at 495.65 MB/s Apr 21 20:55:06 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-877ed380-430e-4635-8f5f-fd75d2bea361 is being set with open permissions: ugo+rw Apr 21 20:55:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-877ed380-430e-4635-8f5f-fd75d2bea361 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:06 devstack sudo[86528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-877ed380-430e-4635-8f5f-fd75d2bea361 Apr 21 20:55:06 devstack sudo[86528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:07 devstack sudo[86523]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e32869ae-2462-4ef6-b4a3-17cee9bd4c46 tempest-VolumesListTestJSON-1171036989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.480s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:07 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-e32869ae-2462-4ef6-b4a3-17cee9bd4c46 tempest-VolumesListTestJSON-1171036989 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:07 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-e32869ae-2462-4ef6-b4a3-17cee9bd4c46 tempest-VolumesListTestJSON-1171036989 None] Deleted volume successfully. Apr 21 20:55:07 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e32869ae-2462-4ef6-b4a3-17cee9bd4c46 tempest-VolumesListTestJSON-1171036989 None] Lock "cinder-fcc42180-c567-4e8c-aa31-143d40b16ef6-delete_volume" released by "delete_volume" :: held 2.629s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:07 devstack sudo[86528]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-877ed380-430e-4635-8f5f-fd75d2bea361" returned: 0 in 0.488s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:07 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Lock "cinder-quobyte-877ed380-430e-4635-8f5f-fd75d2bea361" released by "_copy_volume_from_snapshot" :: held 4.372s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:07 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Acquiring lock "cinder-quobyte-fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:07 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Lock "cinder-quobyte-fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:07 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Deleting offline snapshot fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51 of volume 2f3b26f0-529b-4fa7-a180-a7c31ff854ff {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:55:07 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] snapshot_file for this snap is: volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:55:07 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[af616f2c-122b-4e31-95b9-558f1edf2ab8]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:07 devstack sudo[86533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51 Apr 21 20:55:07 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:07 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51" returned: 0 in 0.557s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:07 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:55:07 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ec2de4-a553-4354-ac99-db034d0bb546]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:08 devstack sudo[86538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff Apr 21 20:55:08 devstack sudo[86538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:08 devstack sudo[86538]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff" returned: 0 in 0.616s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:08 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51 Apr 21 20:55:08 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:09 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51" returned: 0 in 0.604s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:09 devstack sudo[86573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51 Apr 21 20:55:09 devstack sudo[86573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:09 devstack sudo[86573]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff.fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51" returned: 0 in 0.496s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:09 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Lock "cinder-quobyte-fb5dec16-f4cb-43b0-ad7d-de8dbfe92c51" released by "_delete_snapshot" :: held 2.332s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.114s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.267s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:09 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1011725155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5325b3f-9175-4945-ad8f-37988839699a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b23b28f54f4a5a9091cb2f07d8e517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:04Z,use_quota=True,user_id='0f538e84ea4c46278beb237b2ba42f47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:09 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Creating volume e5325b3f-9175-4945-ad8f-37988839699a {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:09 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:09 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:09 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:09 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:55:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e5325b3f-9175-4945-ad8f-37988839699a 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdffcba4-db83-4f85-9374-cc2749081610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-877ed380-430e-4635-8f5f-fd75d2bea361', 'volume_size': 2, 'source_volid': '2f3b26f0-529b-4fa7-a180-a7c31ff854ff', 'source_volstatus': 'available'}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d612bf4-e859-43de-8ccf-50076040b73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:09 devstack sudo[86578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e5325b3f-9175-4945-ad8f-37988839699a 1073741824 Apr 21 20:55:09 devstack sudo[86578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:09 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Volume volume-877ed380-430e-4635-8f5f-fd75d2bea361 (877ed380-430e-4635-8f5f-fd75d2bea361): created successfully Apr 21 20:55:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d612bf4-e859-43de-8ccf-50076040b73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Flow 'volume_create_manager' (c3691a19-3572-4fec-9072-6cd4086da0cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:09 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-60aba222-963c-404c-bdbd-69cf513e5b3c tempest-VolumesCloneTest-1103554038 None] Created volume successfully. Apr 21 20:55:10 devstack sudo[86578]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e5325b3f-9175-4945-ad8f-37988839699a 1073741824" returned: 0 in 0.670s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e5325b3f-9175-4945-ad8f-37988839699a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:10 devstack sudo[86587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e5325b3f-9175-4945-ad8f-37988839699a Apr 21 20:55:10 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:10 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a4ed8e09-ef1e-498e-98ae-1ada8eb6f391 tempest-VolumesCloneTest-1103554038 None] Acquiring lock "cinder-877ed380-430e-4635-8f5f-fd75d2bea361-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:10 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a4ed8e09-ef1e-498e-98ae-1ada8eb6f391 tempest-VolumesCloneTest-1103554038 None] Lock "cinder-877ed380-430e-4635-8f5f-fd75d2bea361-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:10 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a4ed8e09-ef1e-498e-98ae-1ada8eb6f391 tempest-VolumesCloneTest-1103554038 None] Acquiring lock "cinder-quobyte-877ed380-430e-4635-8f5f-fd75d2bea361" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:10 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a4ed8e09-ef1e-498e-98ae-1ada8eb6f391 tempest-VolumesCloneTest-1103554038 None] Lock "cinder-quobyte-877ed380-430e-4635-8f5f-fd75d2bea361" acquired by "delete_volume" :: waited 0.006s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:10 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[3267838e-5fc8-4637-8d20-73fda0b1ecbf]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4ed8e09-ef1e-498e-98ae-1ada8eb6f391 tempest-VolumesCloneTest-1103554038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-877ed380-430e-4635-8f5f-fd75d2bea361 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:10 devstack sudo[86590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-877ed380-430e-4635-8f5f-fd75d2bea361 Apr 21 20:55:10 devstack sudo[86590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:10 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e5325b3f-9175-4945-ad8f-37988839699a" returned: 0 in 0.492s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72027350-1fd0-4516-b545-5f5412af96bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5325b3f-9175-4945-ad8f-37988839699a', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ed62eb-da95-4243-aeca-3d681e79b71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:10 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Volume volume-e5325b3f-9175-4945-ad8f-37988839699a (e5325b3f-9175-4945-ad8f-37988839699a): created successfully Apr 21 20:55:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ed62eb-da95-4243-aeca-3d681e79b71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Flow 'volume_create_manager' (d3068e76-0737-40f4-a7ab-ce964b231f33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:10 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-ce7c2b42-c8d7-46f9-9e9e-9e11418db3b2 tempest-VolumesTransfersTest-1173686632 None] Created volume successfully. Apr 21 20:55:11 devstack cinder-volume[81957]: INFO cinder.volume.manager [req-575aff3d-2881-4276-b6a5-804f9f3577df req-7f6018a2-cc67-48e5-b4a4-645bd832565f tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Terminate volume connection completed successfully. Apr 21 20:55:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [req-575aff3d-2881-4276-b6a5-804f9f3577df req-7f6018a2-cc67-48e5-b4a4-645bd832565f tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Deleting attachment a8df64cb-c5b5-473d-aff6-9abcf028cf9b. {{(pid=81957) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 21 20:55:11 devstack sudo[86590]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4ed8e09-ef1e-498e-98ae-1ada8eb6f391 tempest-VolumesCloneTest-1103554038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-877ed380-430e-4635-8f5f-fd75d2bea361" returned: 0 in 0.523s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4ed8e09-ef1e-498e-98ae-1ada8eb6f391 tempest-VolumesCloneTest-1103554038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-877ed380-430e-4635-8f5f-fd75d2bea361 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:11 devstack sudo[86596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-877ed380-430e-4635-8f5f-fd75d2bea361 Apr 21 20:55:11 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:11 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-575aff3d-2881-4276-b6a5-804f9f3577df req-d90977cc-06d6-4fe3-b77f-248ee97ed7c8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Acquiring lock "cinder-fd661bb0-02cf-45d9-a348-6642c9d8d228-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:11 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-575aff3d-2881-4276-b6a5-804f9f3577df req-d90977cc-06d6-4fe3-b77f-248ee97ed7c8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "cinder-fd661bb0-02cf-45d9-a348-6642c9d8d228-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:11 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4ed8e09-ef1e-498e-98ae-1ada8eb6f391 tempest-VolumesCloneTest-1103554038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-877ed380-430e-4635-8f5f-fd75d2bea361" returned: 0 in 0.442s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:11 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-575aff3d-2881-4276-b6a5-804f9f3577df req-d90977cc-06d6-4fe3-b77f-248ee97ed7c8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Acquiring lock "cinder-quobyte-fd661bb0-02cf-45d9-a348-6642c9d8d228" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:11 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a4ed8e09-ef1e-498e-98ae-1ada8eb6f391 tempest-VolumesCloneTest-1103554038 None] Lock "cinder-quobyte-877ed380-430e-4635-8f5f-fd75d2bea361" released by "delete_volume" :: held 1.000s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:11 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-575aff3d-2881-4276-b6a5-804f9f3577df req-d90977cc-06d6-4fe3-b77f-248ee97ed7c8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "cinder-quobyte-fd661bb0-02cf-45d9-a348-6642c9d8d228" acquired by "delete_volume" :: waited 0.018s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:11 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[299c5079-3407-461d-b7e6-afa548964a70]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-575aff3d-2881-4276-b6a5-804f9f3577df req-d90977cc-06d6-4fe3-b77f-248ee97ed7c8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fd661bb0-02cf-45d9-a348-6642c9d8d228 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:11 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-a4ed8e09-ef1e-498e-98ae-1ada8eb6f391 tempest-VolumesCloneTest-1103554038 None] Created reservations ['0433556a-803a-4c25-87b6-ea0da6f8aba3', 'dd5ce2c2-2b22-4435-8873-2b8e286afd4d', '38c88f27-fb06-4506-906b-515c4a83fb4d', '8e3aef4d-c4ca-4d6a-a7b2-aa6a28ceb047'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:11 devstack sudo[86599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fd661bb0-02cf-45d9-a348-6642c9d8d228 Apr 21 20:55:11 devstack sudo[86599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a4ed8e09-ef1e-498e-98ae-1ada8eb6f391 tempest-VolumesCloneTest-1103554038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a4ed8e09-ef1e-498e-98ae-1ada8eb6f391 tempest-VolumesCloneTest-1103554038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:11 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a4ed8e09-ef1e-498e-98ae-1ada8eb6f391 tempest-VolumesCloneTest-1103554038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:11 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a4ed8e09-ef1e-498e-98ae-1ada8eb6f391 tempest-VolumesCloneTest-1103554038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a4ed8e09-ef1e-498e-98ae-1ada8eb6f391 tempest-VolumesCloneTest-1103554038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4ed8e09-ef1e-498e-98ae-1ada8eb6f391 tempest-VolumesCloneTest-1103554038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:11 devstack sudo[86601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:55:11 devstack sudo[86601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:12 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-40f8da4c-66f3-403a-8547-db3aef416034 tempest-VolumesTransfersTest-449402766 None] Acquiring lock "cinder-e5325b3f-9175-4945-ad8f-37988839699a-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:12 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-40f8da4c-66f3-403a-8547-db3aef416034 tempest-VolumesTransfersTest-449402766 None] Lock "cinder-e5325b3f-9175-4945-ad8f-37988839699a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:12 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-40f8da4c-66f3-403a-8547-db3aef416034 tempest-VolumesTransfersTest-449402766 None] Acquiring lock "cinder-quobyte-e5325b3f-9175-4945-ad8f-37988839699a" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:12 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-40f8da4c-66f3-403a-8547-db3aef416034 tempest-VolumesTransfersTest-449402766 None] Lock "cinder-quobyte-e5325b3f-9175-4945-ad8f-37988839699a" acquired by "delete_volume" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:12 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c3b8f5-1d9c-4018-b48f-8331b05cb9ae]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-40f8da4c-66f3-403a-8547-db3aef416034 tempest-VolumesTransfersTest-449402766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e5325b3f-9175-4945-ad8f-37988839699a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:12 devstack sudo[86604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e5325b3f-9175-4945-ad8f-37988839699a Apr 21 20:55:12 devstack sudo[86604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:12 devstack sudo[86599]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-575aff3d-2881-4276-b6a5-804f9f3577df req-d90977cc-06d6-4fe3-b77f-248ee97ed7c8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fd661bb0-02cf-45d9-a348-6642c9d8d228" returned: 0 in 0.602s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-575aff3d-2881-4276-b6a5-804f9f3577df req-d90977cc-06d6-4fe3-b77f-248ee97ed7c8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fd661bb0-02cf-45d9-a348-6642c9d8d228 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:12 devstack sudo[86609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fd661bb0-02cf-45d9-a348-6642c9d8d228 Apr 21 20:55:12 devstack sudo[86609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:12 devstack sudo[86601]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4ed8e09-ef1e-498e-98ae-1ada8eb6f391 tempest-VolumesCloneTest-1103554038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.640s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:12 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-a4ed8e09-ef1e-498e-98ae-1ada8eb6f391 tempest-VolumesCloneTest-1103554038 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:12 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-a4ed8e09-ef1e-498e-98ae-1ada8eb6f391 tempest-VolumesCloneTest-1103554038 None] Deleted volume successfully. Apr 21 20:55:12 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a4ed8e09-ef1e-498e-98ae-1ada8eb6f391 tempest-VolumesCloneTest-1103554038 None] Lock "cinder-877ed380-430e-4635-8f5f-fd75d2bea361-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:12 devstack sudo[86604]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-40f8da4c-66f3-403a-8547-db3aef416034 tempest-VolumesTransfersTest-449402766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e5325b3f-9175-4945-ad8f-37988839699a" returned: 0 in 0.635s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-40f8da4c-66f3-403a-8547-db3aef416034 tempest-VolumesTransfersTest-449402766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e5325b3f-9175-4945-ad8f-37988839699a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:12 devstack sudo[86614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e5325b3f-9175-4945-ad8f-37988839699a Apr 21 20:55:12 devstack sudo[86614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-faec979e-4fc6-4ab5-96a9-83686071ba43 tempest-VolumesCloneTest-1103554038 None] Acquiring lock "cinder-2f3b26f0-529b-4fa7-a180-a7c31ff854ff-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-faec979e-4fc6-4ab5-96a9-83686071ba43 tempest-VolumesCloneTest-1103554038 None] Lock "cinder-2f3b26f0-529b-4fa7-a180-a7c31ff854ff-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:13 devstack sudo[86609]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-faec979e-4fc6-4ab5-96a9-83686071ba43 tempest-VolumesCloneTest-1103554038 None] Acquiring lock "cinder-quobyte-2f3b26f0-529b-4fa7-a180-a7c31ff854ff" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-575aff3d-2881-4276-b6a5-804f9f3577df req-d90977cc-06d6-4fe3-b77f-248ee97ed7c8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fd661bb0-02cf-45d9-a348-6642c9d8d228" returned: 0 in 0.664s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-faec979e-4fc6-4ab5-96a9-83686071ba43 tempest-VolumesCloneTest-1103554038 None] Lock "cinder-quobyte-2f3b26f0-529b-4fa7-a180-a7c31ff854ff" acquired by "delete_volume" :: waited 0.025s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-575aff3d-2881-4276-b6a5-804f9f3577df req-d90977cc-06d6-4fe3-b77f-248ee97ed7c8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "cinder-quobyte-fd661bb0-02cf-45d9-a348-6642c9d8d228" released by "delete_volume" :: held 1.324s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[107e6880-9a31-441c-ac53-1322809176c3]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-faec979e-4fc6-4ab5-96a9-83686071ba43 tempest-VolumesCloneTest-1103554038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG cinder.quota [req-575aff3d-2881-4276-b6a5-804f9f3577df req-d90977cc-06d6-4fe3-b77f-248ee97ed7c8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Created reservations ['5185290c-dcf2-4d06-a68b-dcc17b234373', '2559ffee-3dc6-48b6-9984-46f25517320c', '4f3b4868-5913-41d7-9c35-7eac4643137b', '87b99b88-1826-4ed4-bce1-612952ec0e20'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-575aff3d-2881-4276-b6a5-804f9f3577df req-d90977cc-06d6-4fe3-b77f-248ee97ed7c8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-575aff3d-2881-4276-b6a5-804f9f3577df req-d90977cc-06d6-4fe3-b77f-248ee97ed7c8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-575aff3d-2881-4276-b6a5-804f9f3577df req-d90977cc-06d6-4fe3-b77f-248ee97ed7c8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [req-575aff3d-2881-4276-b6a5-804f9f3577df req-d90977cc-06d6-4fe3-b77f-248ee97ed7c8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [req-575aff3d-2881-4276-b6a5-804f9f3577df req-d90977cc-06d6-4fe3-b77f-248ee97ed7c8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-575aff3d-2881-4276-b6a5-804f9f3577df req-d90977cc-06d6-4fe3-b77f-248ee97ed7c8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:13 devstack sudo[86617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff Apr 21 20:55:13 devstack sudo[86617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:13 devstack sudo[86618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:55:13 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:13 devstack sudo[86614]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-40f8da4c-66f3-403a-8547-db3aef416034 tempest-VolumesTransfersTest-449402766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-e5325b3f-9175-4945-ad8f-37988839699a" returned: 0 in 0.544s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-40f8da4c-66f3-403a-8547-db3aef416034 tempest-VolumesTransfersTest-449402766 None] Lock "cinder-quobyte-e5325b3f-9175-4945-ad8f-37988839699a" released by "delete_volume" :: held 1.207s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-40f8da4c-66f3-403a-8547-db3aef416034 tempest-VolumesTransfersTest-449402766 None] Created reservations ['1de7e8f6-913d-441e-9362-1220ae9e8051', '22471a55-34bf-4925-b70b-22e0508cdf9b', '9015023d-50e1-4a3f-ae20-f0f069207b5a', '764e8bfa-4310-4cfa-8248-85ef9da6ae81'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-40f8da4c-66f3-403a-8547-db3aef416034 tempest-VolumesTransfersTest-449402766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-40f8da4c-66f3-403a-8547-db3aef416034 tempest-VolumesTransfersTest-449402766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-40f8da4c-66f3-403a-8547-db3aef416034 tempest-VolumesTransfersTest-449402766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-40f8da4c-66f3-403a-8547-db3aef416034 tempest-VolumesTransfersTest-449402766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-40f8da4c-66f3-403a-8547-db3aef416034 tempest-VolumesTransfersTest-449402766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-40f8da4c-66f3-403a-8547-db3aef416034 tempest-VolumesTransfersTest-449402766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:13 devstack sudo[86622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:55:13 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:13 devstack sudo[86617]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-faec979e-4fc6-4ab5-96a9-83686071ba43 tempest-VolumesCloneTest-1103554038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff" returned: 0 in 0.609s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-faec979e-4fc6-4ab5-96a9-83686071ba43 tempest-VolumesCloneTest-1103554038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:13 devstack sudo[86628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff Apr 21 20:55:13 devstack sudo[86628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:13 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [req-575aff3d-2881-4276-b6a5-804f9f3577df req-d90977cc-06d6-4fe3-b77f-248ee97ed7c8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.596s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG cinder.manager [req-575aff3d-2881-4276-b6a5-804f9f3577df req-d90977cc-06d6-4fe3-b77f-248ee97ed7c8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:13 devstack cinder-volume[81957]: INFO cinder.volume.manager [req-575aff3d-2881-4276-b6a5-804f9f3577df req-d90977cc-06d6-4fe3-b77f-248ee97ed7c8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Deleted volume successfully. Apr 21 20:55:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [req-575aff3d-2881-4276-b6a5-804f9f3577df req-d90977cc-06d6-4fe3-b77f-248ee97ed7c8 tempest-ServerBootFromVolumeStableRescueTest-104892085 None] Lock "cinder-fd661bb0-02cf-45d9-a348-6642c9d8d228-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:14 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-40f8da4c-66f3-403a-8547-db3aef416034 tempest-VolumesTransfersTest-449402766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.525s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:14 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-40f8da4c-66f3-403a-8547-db3aef416034 tempest-VolumesTransfersTest-449402766 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:14 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-40f8da4c-66f3-403a-8547-db3aef416034 tempest-VolumesTransfersTest-449402766 None] Deleted volume successfully. Apr 21 20:55:14 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-40f8da4c-66f3-403a-8547-db3aef416034 tempest-VolumesTransfersTest-449402766 None] Lock "cinder-e5325b3f-9175-4945-ad8f-37988839699a-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:14 devstack sudo[86628]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-faec979e-4fc6-4ab5-96a9-83686071ba43 tempest-VolumesCloneTest-1103554038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2f3b26f0-529b-4fa7-a180-a7c31ff854ff" returned: 0 in 0.531s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:14 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-faec979e-4fc6-4ab5-96a9-83686071ba43 tempest-VolumesCloneTest-1103554038 None] Lock "cinder-quobyte-2f3b26f0-529b-4fa7-a180-a7c31ff854ff" released by "delete_volume" :: held 1.176s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:14 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-faec979e-4fc6-4ab5-96a9-83686071ba43 tempest-VolumesCloneTest-1103554038 None] Created reservations ['40e2e0a7-92a9-41ba-b1db-4ccb593ddb07', 'afc8d692-5aaf-4719-be3e-9cd1a4a6be31', '7919bb71-5568-427f-bbd7-69fae42bdf75', '93f512f8-7239-4b0a-b74d-3f0a19474124'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-faec979e-4fc6-4ab5-96a9-83686071ba43 tempest-VolumesCloneTest-1103554038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-faec979e-4fc6-4ab5-96a9-83686071ba43 tempest-VolumesCloneTest-1103554038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:14 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-faec979e-4fc6-4ab5-96a9-83686071ba43 tempest-VolumesCloneTest-1103554038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:14 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-faec979e-4fc6-4ab5-96a9-83686071ba43 tempest-VolumesCloneTest-1103554038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-faec979e-4fc6-4ab5-96a9-83686071ba43 tempest-VolumesCloneTest-1103554038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-faec979e-4fc6-4ab5-96a9-83686071ba43 tempest-VolumesCloneTest-1103554038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:14 devstack sudo[86632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:55:14 devstack sudo[86632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:15 devstack sudo[86632]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-faec979e-4fc6-4ab5-96a9-83686071ba43 tempest-VolumesCloneTest-1103554038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.692s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:15 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-faec979e-4fc6-4ab5-96a9-83686071ba43 tempest-VolumesCloneTest-1103554038 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:15 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-faec979e-4fc6-4ab5-96a9-83686071ba43 tempest-VolumesCloneTest-1103554038 None] Deleted volume successfully. Apr 21 20:55:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-faec979e-4fc6-4ab5-96a9-83686071ba43 tempest-VolumesCloneTest-1103554038 None] Lock "cinder-2f3b26f0-529b-4fa7-a180-a7c31ff854ff-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:18 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Flow 'volume_create_manager' (92f71f20-0ef2-4e22-94b3-7f001d54f51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9719d674-7739-451b-8fd7-96d27b494d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9719d674-7739-451b-8fd7-96d27b494d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1725727768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31430215-e7d5-4293-9d8b-f9ff74bb635e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca535e8c8c634287a4bf84c22d172f12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:18Z,use_quota=True,user_id='b6f0657ef2474f2ea05a36daa9e80a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0242059a-f58c-4ca1-844a-c68e63d915c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0242059a-f58c-4ca1-844a-c68e63d915c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (499e83d6-ef82-489a-b318-ec37b54ef21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:18 devstack cinder-volume[81957]: DEBUG cinder.image.glance [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Creating Keystone auth plugin from conf {{(pid=81957) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 21 20:55:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (499e83d6-ef82-489a-b318-ec37b54ef21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '31430215-e7d5-4293-9d8b-f9ff74bb635e', 'volume_name': 'volume-31430215-e7d5-4293-9d8b-f9ff74bb635e', 'volume_size': 1, 'image_id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea9a1f20637b41ec8f283a778363aed0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c112cf7-9f7d-490e-8e52-abb08838bafa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d3f49a-bbb9-423e-87b1-3525dcd96e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d3f49a-bbb9-423e-87b1-3525dcd96e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc4512b-4d55-48d6-911d-0aba9a838c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:18 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Volume 31430215-e7d5-4293-9d8b-f9ff74bb635e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-31430215-e7d5-4293-9d8b-f9ff74bb635e', 'volume_size': 1, 'image_id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea9a1f20637b41ec8f283a778363aed0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c112cf7-9f7d-490e-8e52-abb08838bafa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 21 20:55:18 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Trying to clone 31430215-e7d5-4293-9d8b-f9ff74bb635e from image 1c112cf7-9f7d-490e-8e52-abb08838bafa at location (None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}]). {{(pid=81957) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 21 20:55:18 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_dyydbstadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81957) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 21 20:55:18 devstack cinder-volume[81957]: INFO cinder.image.image_utils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Image download 20.69 MB at 20.69 MB/s Apr 21 20:55:18 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cf3a19-2822-409f-a8a4-70bb62060d50]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_dyydbstadevstack@QuobyteHD {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:18 devstack sudo[86756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_dyydbstadevstack@QuobyteHD Apr 21 20:55:18 devstack sudo[86756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Flow 'volume_create_manager' (a12352d9-5a89-4f5b-9658-7d0b6f0b7a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef69504f-0505-469e-984b-8c7f05ab1e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef69504f-0505-469e-984b-8c7f05ab1e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-77261976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c2cc13-53ed-45d2-b5fc-bafeeb29303b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8129f201a84614bf05b42dac0fc7e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:19Z,use_quota=True,user_id='a788217e50bb43b4a136c62bbe903817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c8d6c31-8dcb-41a2-8f77-9d8e9f610d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c8d6c31-8dcb-41a2-8f77-9d8e9f610d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a499ad-2b3f-40c8-867e-389fd92dafc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a499ad-2b3f-40c8-867e-389fd92dafc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2c2cc13-53ed-45d2-b5fc-bafeeb29303b', 'volume_name': 'volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4658fa1-26c0-4a66-8033-00c0554e889b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4658fa1-26c0-4a66-8033-00c0554e889b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a5be269-ac15-420c-b89f-079a664b5938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:19 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Volume d2c2cc13-53ed-45d2-b5fc-bafeeb29303b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b', 'volume_size': 1} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-77261976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c2cc13-53ed-45d2-b5fc-bafeeb29303b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8129f201a84614bf05b42dac0fc7e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:19Z,use_quota=True,user_id='a788217e50bb43b4a136c62bbe903817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Creating volume d2c2cc13-53ed-45d2-b5fc-bafeeb29303b {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:19 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:19 devstack sudo[86759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b 1073741824 Apr 21 20:55:19 devstack sudo[86759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:19 devstack sudo[86756]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_dyydbstadevstack@QuobyteHD" returned: 0 in 0.626s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Temporary image 1c112cf7-9f7d-490e-8e52-abb08838bafa is fetched for user b6f0657ef2474f2ea05a36daa9e80a5c. {{(pid=81957) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[830f544c-036e-47ca-8cfd-9f436f9a3157]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_dyydbstadevstack@QuobyteHD {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:19 devstack sudo[86764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_dyydbstadevstack@QuobyteHD Apr 21 20:55:19 devstack sudo[86764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:19 devstack sudo[86759]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b 1073741824" returned: 0 in 0.584s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:19 devstack sudo[86769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b Apr 21 20:55:19 devstack sudo[86769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:20 devstack sudo[86764]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_dyydbstadevstack@QuobyteHD" returned: 0 in 0.635s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:20 devstack sudo[86769]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b" returned: 0 in 0.526s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.154s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1725727768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31430215-e7d5-4293-9d8b-f9ff74bb635e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca535e8c8c634287a4bf84c22d172f12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:18Z,use_quota=True,user_id='b6f0657ef2474f2ea05a36daa9e80a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Creating volume 31430215-e7d5-4293-9d8b-f9ff74bb635e {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:20 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:55:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:20 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a5be269-ac15-420c-b89f-079a664b5938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:20 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83696b3-1d77-44a9-be04-12b4b6e5054d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:20 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e 1073741824 Apr 21 20:55:20 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:20 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Volume volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b (d2c2cc13-53ed-45d2-b5fc-bafeeb29303b): created successfully Apr 21 20:55:20 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83696b3-1d77-44a9-be04-12b4b6e5054d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:20 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Flow 'volume_create_manager' (a12352d9-5a89-4f5b-9658-7d0b6f0b7a22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:20 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-fe430a6d-9378-4962-92e8-524741619866 tempest-VolumesSnapshotTestJSON-1313411673 None] Created volume successfully. Apr 21 20:55:20 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e 1073741824" returned: 0 in 0.602s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:20 devstack sudo[86780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e Apr 21 20:55:20 devstack sudo[86780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-067d121c-3fe1-44d0-81b7-7dfa223bd3f6 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:21 devstack sudo[86780]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e" returned: 0 in 0.483s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:21 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-067d121c-3fe1-44d0-81b7-7dfa223bd3f6 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.018s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:21 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-067d121c-3fe1-44d0-81b7-7dfa223bd3f6 tempest-VolumesSnapshotTestJSON-1313411673 None] Creating offline snapshot 10589752-7483-4316-8261-d80b78b7a49a of volume d2c2cc13-53ed-45d2-b5fc-bafeeb29303b {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:55:21 devstack cinder-volume[81957]: DEBUG cinder.volume.volume_utils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Attempting download of 1c112cf7-9f7d-490e-8e52-abb08838bafa ((None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}])) to volume 31430215-e7d5-4293-9d8b-f9ff74bb635e. {{(pid=81957) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 21 20:55:21 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[5919b65b-a232-4d93-b000-9fb15b70bc3f]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-067d121c-3fe1-44d0-81b7-7dfa223bd3f6 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:21 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e18666-8daa-4e16-8f2b-e36bd43c51ed]: (4, 'raw') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_tnl8xz_4 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:21 devstack sudo[86783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b Apr 21 20:55:21 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:21 devstack sudo[86784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_tnl8xz_4 Apr 21 20:55:21 devstack sudo[86784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:22 devstack sudo[86784]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_tnl8xz_4" returned: 0 in 0.529s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_tnl8xz_4 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:22 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-067d121c-3fe1-44d0-81b7-7dfa223bd3f6 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b" returned: 0 in 0.652s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:22 devstack sudo[86792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_tnl8xz_4 Apr 21 20:55:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-067d121c-3fe1-44d0-81b7-7dfa223bd3f6 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.10589752-7483-4316-8261-d80b78b7a49a 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:22 devstack sudo[86792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:22 devstack sudo[86794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.10589752-7483-4316-8261-d80b78b7a49a 1G Apr 21 20:55:22 devstack sudo[86794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:22 devstack sudo[86792]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_tnl8xz_4" returned: 1 in 0.553s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_tnl8xz_4' failed. Not Retrying. {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:55:22 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7835b3-1120-413d-994b-f43a47808f17]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_dyydbstadevstack@QuobyteHD {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:22 devstack sudo[86801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_dyydbstadevstack@QuobyteHD Apr 21 20:55:22 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:22 devstack sudo[86794]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-067d121c-3fe1-44d0-81b7-7dfa223bd3f6 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.10589752-7483-4316-8261-d80b78b7a49a 1G" returned: 0 in 0.634s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-067d121c-3fe1-44d0-81b7-7dfa223bd3f6 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.10589752-7483-4316-8261-d80b78b7a49a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:22 devstack sudo[86803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.10589752-7483-4316-8261-d80b78b7a49a Apr 21 20:55:22 devstack sudo[86803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:23 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_dyydbstadevstack@QuobyteHD" returned: 0 in 0.573s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:23 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] 1c112cf7-9f7d-490e-8e52-abb08838bafa was qcow2, converting to raw {{(pid=81957) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 21 20:55:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_dyydbstadevstack@QuobyteHD /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:23 devstack sudo[86811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_dyydbstadevstack@QuobyteHD /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e Apr 21 20:55:23 devstack sudo[86811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:23 devstack sudo[86803]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-067d121c-3fe1-44d0-81b7-7dfa223bd3f6 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.10589752-7483-4316-8261-d80b78b7a49a" returned: 0 in 0.479s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:23 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-067d121c-3fe1-44d0-81b7-7dfa223bd3f6 tempest-VolumesSnapshotTestJSON-1313411673 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.10589752-7483-4316-8261-d80b78b7a49a is being set with open permissions: ugo+rw Apr 21 20:55:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-067d121c-3fe1-44d0-81b7-7dfa223bd3f6 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.10589752-7483-4316-8261-d80b78b7a49a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:23 devstack sudo[86813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.10589752-7483-4316-8261-d80b78b7a49a Apr 21 20:55:23 devstack sudo[86813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:23 devstack sudo[86813]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-067d121c-3fe1-44d0-81b7-7dfa223bd3f6 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.10589752-7483-4316-8261-d80b78b7a49a" returned: 0 in 0.601s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-067d121c-3fe1-44d0-81b7-7dfa223bd3f6 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:23 devstack sudo[86831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.info Apr 21 20:55:23 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:24 devstack sudo[86811]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_dyydbstadevstack@QuobyteHD /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e" returned: 0 in 1.259s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:24 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_dyydbstadevstack@QuobyteHD, size 112.00 MB, duration 1.26 sec, destination /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e {{(pid=81957) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:55:24 devstack cinder-volume[81957]: INFO cinder.image.image_utils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Converted 112.00 MB image at 88.86 MB/s Apr 21 20:55:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:24 devstack sudo[86837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e 1G Apr 21 20:55:24 devstack sudo[86837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:24 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-067d121c-3fe1-44d0-81b7-7dfa223bd3f6 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.info" returned: 0 in 0.691s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:24 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-067d121c-3fe1-44d0-81b7-7dfa223bd3f6 tempest-VolumesSnapshotTestJSON-1313411673 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.info is being set with open permissions: ugo+rw Apr 21 20:55:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-067d121c-3fe1-44d0-81b7-7dfa223bd3f6 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:24 devstack sudo[86839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.info Apr 21 20:55:24 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:25 devstack sudo[86837]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e 1G" returned: 0 in 0.639s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:25 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[906b48fb-28c3-4e26-bbb2-a765b028c926]: (4, 'raw') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:25 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-067d121c-3fe1-44d0-81b7-7dfa223bd3f6 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.info" returned: 0 in 0.564s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-067d121c-3fe1-44d0-81b7-7dfa223bd3f6 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.705s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:25 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-067d121c-3fe1-44d0-81b7-7dfa223bd3f6 tempest-VolumesSnapshotTestJSON-1313411673 None] Create snapshot completed successfully Apr 21 20:55:25 devstack sudo[86845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e Apr 21 20:55:25 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-eb30403c-bab3-47c3-bdba-9e4e5c7e55eb tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "cinder-10589752-7483-4316-8261-d80b78b7a49a-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-eb30403c-bab3-47c3-bdba-9e4e5c7e55eb tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-10589752-7483-4316-8261-d80b78b7a49a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:25 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e" returned: 0 in 0.682s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-eb30403c-bab3-47c3-bdba-9e4e5c7e55eb tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "cinder-quobyte-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-eb30403c-bab3-47c3-bdba-9e4e5c7e55eb tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-eb30403c-bab3-47c3-bdba-9e4e5c7e55eb tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "cinder-quobyte-10589752-7483-4316-8261-d80b78b7a49a" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-eb30403c-bab3-47c3-bdba-9e4e5c7e55eb tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-10589752-7483-4316-8261-d80b78b7a49a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:25 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-eb30403c-bab3-47c3-bdba-9e4e5c7e55eb tempest-VolumesSnapshotTestJSON-1313411673 None] Deleting offline snapshot 10589752-7483-4316-8261-d80b78b7a49a of volume d2c2cc13-53ed-45d2-b5fc-bafeeb29303b {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:55:25 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-eb30403c-bab3-47c3-bdba-9e4e5c7e55eb tempest-VolumesSnapshotTestJSON-1313411673 None] snapshot_file for this snap is: volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.10589752-7483-4316-8261-d80b78b7a49a {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:55:25 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4fa03a-d3e7-4b7f-a55e-548fa3b5356a]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-eb30403c-bab3-47c3-bdba-9e4e5c7e55eb tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.10589752-7483-4316-8261-d80b78b7a49a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:25 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e Apr 21 20:55:25 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:25 devstack sudo[86850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.10589752-7483-4316-8261-d80b78b7a49a Apr 21 20:55:25 devstack sudo[86850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:26 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e" returned: 1 in 0.669s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e' failed. Not Retrying. {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:55:26 devstack sudo[86850]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:26 devstack cinder-volume[81957]: DEBUG cinder.volume.volume_utils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Downloaded image 1c112cf7-9f7d-490e-8e52-abb08838bafa ((None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}])) to volume 31430215-e7d5-4293-9d8b-f9ff74bb635e successfully. {{(pid=81957) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 21 20:55:26 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Temporary image 1c112cf7-9f7d-490e-8e52-abb08838bafa for user b6f0657ef2474f2ea05a36daa9e80a5c is deleted. {{(pid=81957) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 21 20:55:26 devstack cinder-volume[81957]: DEBUG cinder.volume.volume_utils [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Marking volume 31430215-e7d5-4293-9d8b-f9ff74bb635e as bootable. {{(pid=81957) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 21 20:55:26 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Copying metadata from image 1c112cf7-9f7d-490e-8e52-abb08838bafa to 31430215-e7d5-4293-9d8b-f9ff74bb635e. {{(pid=81957) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 21 20:55:26 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Creating volume glance metadata for volume 31430215-e7d5-4293-9d8b-f9ff74bb635e backed by image 1c112cf7-9f7d-490e-8e52-abb08838bafa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81957) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 21 20:55:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-eb30403c-bab3-47c3-bdba-9e4e5c7e55eb tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.10589752-7483-4316-8261-d80b78b7a49a" returned: 0 in 0.647s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:26 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-eb30403c-bab3-47c3-bdba-9e4e5c7e55eb tempest-VolumesSnapshotTestJSON-1313411673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:55:26 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[10345228-71ee-4b73-b115-0a43e307fba5]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-eb30403c-bab3-47c3-bdba-9e4e5c7e55eb tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc4512b-4d55-48d6-911d-0aba9a838c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31430215-e7d5-4293-9d8b-f9ff74bb635e', 'volume_size': 1, 'image_id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea9a1f20637b41ec8f283a778363aed0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c112cf7-9f7d-490e-8e52-abb08838bafa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25810e39-4ecd-4308-998d-a6fd8e69fd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:26 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Volume volume-31430215-e7d5-4293-9d8b-f9ff74bb635e (31430215-e7d5-4293-9d8b-f9ff74bb635e): created successfully Apr 21 20:55:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25810e39-4ecd-4308-998d-a6fd8e69fd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:26 devstack sudo[86859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b Apr 21 20:55:26 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Flow 'volume_create_manager' (92f71f20-0ef2-4e22-94b3-7f001d54f51c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:26 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-8a9f92fc-7add-41e3-a099-2f00c9d6df5e tempest-VolumesExtendTest-785278597 None] Created volume successfully. Apr 21 20:55:27 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-eb30403c-bab3-47c3-bdba-9e4e5c7e55eb tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b" returned: 0 in 0.653s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-eb30403c-bab3-47c3-bdba-9e4e5c7e55eb tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.10589752-7483-4316-8261-d80b78b7a49a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:27 devstack sudo[86864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.10589752-7483-4316-8261-d80b78b7a49a Apr 21 20:55:27 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-57043a34-9b34-4d00-a893-5b86d61a4b71 tempest-VolumesExtendTest-785278597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-57043a34-9b34-4d00-a893-5b86d61a4b71 tempest-VolumesExtendTest-785278597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:27 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1ae2b3-2d32-4da2-9d1f-4048ba5436f3]: (4, 'raw') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-57043a34-9b34-4d00-a893-5b86d61a4b71 tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:27 devstack sudo[86869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e Apr 21 20:55:27 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:27 devstack sudo[86869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-eb30403c-bab3-47c3-bdba-9e4e5c7e55eb tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.10589752-7483-4316-8261-d80b78b7a49a" returned: 0 in 0.702s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-eb30403c-bab3-47c3-bdba-9e4e5c7e55eb tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.10589752-7483-4316-8261-d80b78b7a49a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:27 devstack sudo[86872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.10589752-7483-4316-8261-d80b78b7a49a Apr 21 20:55:27 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:28 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Flow 'volume_create_manager' (66e49e1b-c436-49fc-99b2-8017ed5ef40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95ef4a5-5f19-4786-8bef-54993e40d98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95ef4a5-5f19-4786-8bef-54993e40d98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1689162671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e53625-e51c-4981-b33b-aaf9b4587db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5290a3e0783444286c1a1ca3737aed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:28Z,use_quota=True,user_id='d854255f2c0d4f22b366fcf69cbab6db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41054a77-cbf1-4e4b-b544-402f3b9f1d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41054a77-cbf1-4e4b-b544-402f3b9f1d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9850f299-269b-45d6-b803-ed46754804a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9850f299-269b-45d6-b803-ed46754804a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0e53625-e51c-4981-b33b-aaf9b4587db7', 'volume_name': 'volume-a0e53625-e51c-4981-b33b-aaf9b4587db7', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c91257-3203-48e1-a880-fce803a58714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c91257-3203-48e1-a880-fce803a58714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6b12dd-898a-491b-a650-5ce27f92997c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:28 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Volume a0e53625-e51c-4981-b33b-aaf9b4587db7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0e53625-e51c-4981-b33b-aaf9b4587db7', 'volume_size': 1} Apr 21 20:55:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:28 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-eb30403c-bab3-47c3-bdba-9e4e5c7e55eb tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b.10589752-7483-4316-8261-d80b78b7a49a" returned: 0 in 0.565s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:28 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-eb30403c-bab3-47c3-bdba-9e4e5c7e55eb tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-10589752-7483-4316-8261-d80b78b7a49a" released by "_delete_snapshot" :: held 2.652s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:28 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-eb30403c-bab3-47c3-bdba-9e4e5c7e55eb tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b" released by "delete_snapshot" :: held 2.668s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:28 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-eb30403c-bab3-47c3-bdba-9e4e5c7e55eb tempest-VolumesSnapshotTestJSON-1313411673 None] Created reservations ['d6541546-8598-4bc0-a576-8ac95fee8417', '56efff21-52ee-4575-a995-b8195c4d5fb0', '51af7288-22d3-4231-ac58-1f24848e75a9', '865638f1-08fa-42eb-9b23-d195a9c24f34'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:28 devstack sudo[86869]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-57043a34-9b34-4d00-a893-5b86d61a4b71 tempest-VolumesExtendTest-785278597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e" returned: 0 in 0.761s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-57043a34-9b34-4d00-a893-5b86d61a4b71 tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:28 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-eb30403c-bab3-47c3-bdba-9e4e5c7e55eb tempest-VolumesSnapshotTestJSON-1313411673 None] Delete snapshot completed successfully. Apr 21 20:55:28 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-eb30403c-bab3-47c3-bdba-9e4e5c7e55eb tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-10589752-7483-4316-8261-d80b78b7a49a-delete_snapshot" released by "delete_snapshot" :: held 2.808s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:28 devstack sudo[86877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e Apr 21 20:55:28 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:29 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-57043a34-9b34-4d00-a893-5b86d61a4b71 tempest-VolumesExtendTest-785278597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e" returned: 1 in 0.561s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-57043a34-9b34-4d00-a893-5b86d61a4b71 tempest-VolumesExtendTest-785278597 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e' failed. Not Retrying. {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-57043a34-9b34-4d00-a893-5b86d61a4b71 tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e 2G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-57043a34-9b34-4d00-a893-5b86d61a4b71 tempest-VolumesExtendTest-785278597 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e 2G" returned: 0 in 0.052s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-57043a34-9b34-4d00-a893-5b86d61a4b71 tempest-VolumesExtendTest-785278597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.411s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.775s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1689162671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e53625-e51c-4981-b33b-aaf9b4587db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5290a3e0783444286c1a1ca3737aed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:28Z,use_quota=True,user_id='d854255f2c0d4f22b366fcf69cbab6db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Creating volume a0e53625-e51c-4981-b33b-aaf9b4587db7 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:29 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:29 devstack sudo[86886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 1073741824 Apr 21 20:55:29 devstack sudo[86886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Flow 'volume_create_manager' (ebb3f66c-47bb-4573-8930-31fa14ace94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e853282-ba98-46ac-a464-5c75aa240664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e853282-ba98-46ac-a464-5c75aa240664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-129614656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d954bdba-6f7b-42a6-8998-7d7206a638e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8129f201a84614bf05b42dac0fc7e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:29Z,use_quota=True,user_id='a788217e50bb43b4a136c62bbe903817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f984d62d-fff4-43ec-9ca6-9b8079f1d654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f984d62d-fff4-43ec-9ca6-9b8079f1d654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be7d65eb-4934-4350-9365-685afdc3a88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be7d65eb-4934-4350-9365-685afdc3a88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd954bdba-6f7b-42a6-8998-7d7206a638e9', 'volume_name': 'volume-d954bdba-6f7b-42a6-8998-7d7206a638e9', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7513ca-f90d-4a65-8a3d-9e8ca4cfa1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7513ca-f90d-4a65-8a3d-9e8ca4cfa1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc778cef-ec1f-449a-866f-c34dd6d760f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:29 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Volume d954bdba-6f7b-42a6-8998-7d7206a638e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d954bdba-6f7b-42a6-8998-7d7206a638e9', 'volume_size': 1} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:29 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-57043a34-9b34-4d00-a893-5b86d61a4b71 tempest-VolumesExtendTest-785278597 None] Extend volume completed successfully. Apr 21 20:55:29 devstack sudo[86886]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 1073741824" returned: 0 in 0.529s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:29 devstack sudo[86891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 Apr 21 20:55:29 devstack sudo[86891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f053718a-c39a-413e-b659-61f964df6843 tempest-VolumesExtendTest-785278597 None] Acquiring lock "cinder-31430215-e7d5-4293-9d8b-f9ff74bb635e-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f053718a-c39a-413e-b659-61f964df6843 tempest-VolumesExtendTest-785278597 None] Lock "cinder-31430215-e7d5-4293-9d8b-f9ff74bb635e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f053718a-c39a-413e-b659-61f964df6843 tempest-VolumesExtendTest-785278597 None] Acquiring lock "cinder-quobyte-31430215-e7d5-4293-9d8b-f9ff74bb635e" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f053718a-c39a-413e-b659-61f964df6843 tempest-VolumesExtendTest-785278597 None] Lock "cinder-quobyte-31430215-e7d5-4293-9d8b-f9ff74bb635e" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[5333915c-80fb-4c31-8076-6ffd6af9a348]: (4, 'raw') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f053718a-c39a-413e-b659-61f964df6843 tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:30 devstack sudo[86891]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7" returned: 0 in 0.563s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.984s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-129614656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d954bdba-6f7b-42a6-8998-7d7206a638e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8129f201a84614bf05b42dac0fc7e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:29Z,use_quota=True,user_id='a788217e50bb43b4a136c62bbe903817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Creating volume d954bdba-6f7b-42a6-8998-7d7206a638e9 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:30 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:30 devstack sudo[86894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e Apr 21 20:55:30 devstack sudo[86894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:30 devstack sudo[86896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 1073741824 Apr 21 20:55:30 devstack sudo[86896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6b12dd-898a-491b-a650-5ce27f92997c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0e53625-e51c-4981-b33b-aaf9b4587db7', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ccaed98-50cf-40d7-bcea-2d7b46e1fbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:30 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Volume volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 (a0e53625-e51c-4981-b33b-aaf9b4587db7): created successfully Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ccaed98-50cf-40d7-bcea-2d7b46e1fbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Flow 'volume_create_manager' (66e49e1b-c436-49fc-99b2-8017ed5ef40c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:30 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-25b42d97-5fca-4a58-b6df-3469020d7c56 tempest-VolumesActionsTest-541426287 None] Created volume successfully. Apr 21 20:55:30 devstack sudo[86894]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f053718a-c39a-413e-b659-61f964df6843 tempest-VolumesExtendTest-785278597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e" returned: 0 in 0.531s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f053718a-c39a-413e-b659-61f964df6843 tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:30 devstack sudo[86903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e Apr 21 20:55:30 devstack sudo[86903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:30 devstack sudo[86896]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 1073741824" returned: 0 in 0.578s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:30 devstack sudo[86905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 Apr 21 20:55:30 devstack sudo[86905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:31 devstack sudo[86903]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f053718a-c39a-413e-b659-61f964df6843 tempest-VolumesExtendTest-785278597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e" returned: 1 in 0.624s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f053718a-c39a-413e-b659-61f964df6843 tempest-VolumesExtendTest-785278597 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e' failed. Not Retrying. {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:55:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f053718a-c39a-413e-b659-61f964df6843 tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:31 devstack sudo[86911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e Apr 21 20:55:31 devstack sudo[86911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:31 devstack sudo[86905]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9" returned: 0 in 0.481s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:31 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc778cef-ec1f-449a-866f-c34dd6d760f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d954bdba-6f7b-42a6-8998-7d7206a638e9', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced17469-9a9f-46f7-9f2e-a1688d2a5b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:31 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Volume volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 (d954bdba-6f7b-42a6-8998-7d7206a638e9): created successfully Apr 21 20:55:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced17469-9a9f-46f7-9f2e-a1688d2a5b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Flow 'volume_create_manager' (ebb3f66c-47bb-4573-8930-31fa14ace94b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:31 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-23beecab-3c8a-478d-bac6-68db38432e74 tempest-VolumesSnapshotTestJSON-1313411673 None] Created volume successfully. Apr 21 20:55:31 devstack sudo[86911]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f053718a-c39a-413e-b659-61f964df6843 tempest-VolumesExtendTest-785278597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-31430215-e7d5-4293-9d8b-f9ff74bb635e" returned: 0 in 0.459s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:31 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f053718a-c39a-413e-b659-61f964df6843 tempest-VolumesExtendTest-785278597 None] Lock "cinder-quobyte-31430215-e7d5-4293-9d8b-f9ff74bb635e" released by "delete_volume" :: held 1.687s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:31 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-f053718a-c39a-413e-b659-61f964df6843 tempest-VolumesExtendTest-785278597 None] Created reservations ['7623f070-5627-4c04-86b2-35bf79ab4e99', '3246c8be-9dc7-4cac-b2db-571bd8ff3d34', '1022b222-04fd-4893-9bd7-834b4692795f', 'b89a2d3e-f901-4a3a-8606-040a2bd279b5'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f053718a-c39a-413e-b659-61f964df6843 tempest-VolumesExtendTest-785278597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f053718a-c39a-413e-b659-61f964df6843 tempest-VolumesExtendTest-785278597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:31 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f053718a-c39a-413e-b659-61f964df6843 tempest-VolumesExtendTest-785278597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:31 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f053718a-c39a-413e-b659-61f964df6843 tempest-VolumesExtendTest-785278597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f053718a-c39a-413e-b659-61f964df6843 tempest-VolumesExtendTest-785278597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f053718a-c39a-413e-b659-61f964df6843 tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:31 devstack sudo[86914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:55:31 devstack sudo[86914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:32 devstack sudo[86914]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f053718a-c39a-413e-b659-61f964df6843 tempest-VolumesExtendTest-785278597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.511s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-f053718a-c39a-413e-b659-61f964df6843 tempest-VolumesExtendTest-785278597 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:32 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-f053718a-c39a-413e-b659-61f964df6843 tempest-VolumesExtendTest-785278597 None] Deleted volume successfully. Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f053718a-c39a-413e-b659-61f964df6843 tempest-VolumesExtendTest-785278597 None] Lock "cinder-31430215-e7d5-4293-9d8b-f9ff74bb635e-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Flow 'volume_create_manager' (4a67c79b-b5a5-49f4-b861-839e18d4687c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1525679d-3f00-4af6-9f15-a8abd5058745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1525679d-3f00-4af6-9f15-a8abd5058745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1290434679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16848996-f5df-483d-95fa-9dc443afc1b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca535e8c8c634287a4bf84c22d172f12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:33Z,use_quota=True,user_id='b6f0657ef2474f2ea05a36daa9e80a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe58d304-0895-425b-9df7-dc50c8caf414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe58d304-0895-425b-9df7-dc50c8caf414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4936266-c041-4b42-91e2-b06fafad8a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4936266-c041-4b42-91e2-b06fafad8a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16848996-f5df-483d-95fa-9dc443afc1b6', 'volume_name': 'volume-16848996-f5df-483d-95fa-9dc443afc1b6', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22285d30-f75e-4d82-a783-5931053f7f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22285d30-f75e-4d82-a783-5931053f7f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b619181-0261-4c84-9144-a652c18c4c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:32 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Volume 16848996-f5df-483d-95fa-9dc443afc1b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16848996-f5df-483d-95fa-9dc443afc1b6', 'volume_size': 1} Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1290434679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16848996-f5df-483d-95fa-9dc443afc1b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca535e8c8c634287a4bf84c22d172f12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:33Z,use_quota=True,user_id='b6f0657ef2474f2ea05a36daa9e80a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Creating volume 16848996-f5df-483d-95fa-9dc443afc1b6 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:32 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6219457e-5e57-4c73-afd0-6fe3364de670 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:32 devstack sudo[86922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6 1073741824 Apr 21 20:55:32 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:33 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6 1073741824" returned: 0 in 0.536s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:33 devstack sudo[86928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6 Apr 21 20:55:33 devstack sudo[86928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:33 devstack sudo[86928]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6" returned: 0 in 0.469s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6219457e-5e57-4c73-afd0-6fe3364de670 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.017s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b619181-0261-4c84-9144-a652c18c4c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16848996-f5df-483d-95fa-9dc443afc1b6', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee203a26-4547-4ba8-ac5d-093a6ef27f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-6219457e-5e57-4c73-afd0-6fe3364de670 tempest-VolumesSnapshotTestJSON-1313411673 None] Creating offline snapshot bae3330c-3b79-4001-97b6-f86582cfe2f9 of volume d954bdba-6f7b-42a6-8998-7d7206a638e9 {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:55:33 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Volume volume-16848996-f5df-483d-95fa-9dc443afc1b6 (16848996-f5df-483d-95fa-9dc443afc1b6): created successfully Apr 21 20:55:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee203a26-4547-4ba8-ac5d-093a6ef27f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Flow 'volume_create_manager' (4a67c79b-b5a5-49f4-b861-839e18d4687c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:33 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fce7809-8af5-4619-9682-3e186940c927]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6219457e-5e57-4c73-afd0-6fe3364de670 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:33 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-9040ce40-0c2a-42c5-8334-e7b021a3498f tempest-VolumesExtendTest-785278597 None] Created volume successfully. Apr 21 20:55:33 devstack sudo[86931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 Apr 21 20:55:33 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:34 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6219457e-5e57-4c73-afd0-6fe3364de670 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9" returned: 0 in 0.590s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6219457e-5e57-4c73-afd0-6fe3364de670 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.bae3330c-3b79-4001-97b6-f86582cfe2f9 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:34 devstack sudo[86936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.bae3330c-3b79-4001-97b6-f86582cfe2f9 1G Apr 21 20:55:34 devstack sudo[86936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a4f24165-2e0e-47ec-994c-7092fb5e44c0 tempest-VolumesExtendTest-785278597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:34 devstack sudo[86936]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6219457e-5e57-4c73-afd0-6fe3364de670 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.bae3330c-3b79-4001-97b6-f86582cfe2f9 1G" returned: 0 in 0.562s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6219457e-5e57-4c73-afd0-6fe3364de670 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.bae3330c-3b79-4001-97b6-f86582cfe2f9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:34 devstack sudo[86941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.bae3330c-3b79-4001-97b6-f86582cfe2f9 Apr 21 20:55:34 devstack sudo[86941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:35 devstack sudo[86941]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6219457e-5e57-4c73-afd0-6fe3364de670 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.bae3330c-3b79-4001-97b6-f86582cfe2f9" returned: 0 in 0.426s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:35 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-6219457e-5e57-4c73-afd0-6fe3364de670 tempest-VolumesSnapshotTestJSON-1313411673 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.bae3330c-3b79-4001-97b6-f86582cfe2f9 is being set with open permissions: ugo+rw Apr 21 20:55:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6219457e-5e57-4c73-afd0-6fe3364de670 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.bae3330c-3b79-4001-97b6-f86582cfe2f9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:35 devstack sudo[86946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.bae3330c-3b79-4001-97b6-f86582cfe2f9 Apr 21 20:55:35 devstack sudo[86946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:35 devstack sudo[86946]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6219457e-5e57-4c73-afd0-6fe3364de670 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.bae3330c-3b79-4001-97b6-f86582cfe2f9" returned: 0 in 0.532s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6219457e-5e57-4c73-afd0-6fe3364de670 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:35 devstack sudo[86949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.info Apr 21 20:55:35 devstack sudo[86949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:36 devstack sudo[86949]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6219457e-5e57-4c73-afd0-6fe3364de670 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.info" returned: 0 in 0.474s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:36 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-6219457e-5e57-4c73-afd0-6fe3364de670 tempest-VolumesSnapshotTestJSON-1313411673 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.info is being set with open permissions: ugo+rw Apr 21 20:55:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6219457e-5e57-4c73-afd0-6fe3364de670 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:36 devstack sudo[86952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.info Apr 21 20:55:36 devstack sudo[86952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:36 devstack sudo[86952]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6219457e-5e57-4c73-afd0-6fe3364de670 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.info" returned: 0 in 0.450s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6219457e-5e57-4c73-afd0-6fe3364de670 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.144s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a4f24165-2e0e-47ec-994c-7092fb5e44c0 tempest-VolumesExtendTest-785278597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.028s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:36 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:SELECT=142,cinder:INSERT=65,cinder:DELETE=18,cinder:UPDATE=184 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:55:36 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:SELECT=166,cinder:UPDATE=198,cinder:DELETE=15,cinder:INSERT=39 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:55:36 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-a4f24165-2e0e-47ec-994c-7092fb5e44c0 tempest-VolumesExtendTest-785278597 None] Creating offline snapshot b80448b0-86aa-4a65-8241-c6ab49154e71 of volume 16848996-f5df-483d-95fa-9dc443afc1b6 {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:55:36 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bb8505-a7f6-4768-a379-f737ccfe6d23]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:36 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-6219457e-5e57-4c73-afd0-6fe3364de670 tempest-VolumesSnapshotTestJSON-1313411673 None] Create snapshot completed successfully Apr 21 20:55:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4f24165-2e0e-47ec-994c-7092fb5e44c0 tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:37 devstack sudo[86961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6 Apr 21 20:55:37 devstack sudo[86961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:37 devstack sudo[86961]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4f24165-2e0e-47ec-994c-7092fb5e44c0 tempest-VolumesExtendTest-785278597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6" returned: 0 in 0.529s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4f24165-2e0e-47ec-994c-7092fb5e44c0 tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.b80448b0-86aa-4a65-8241-c6ab49154e71 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:37 devstack sudo[86966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.b80448b0-86aa-4a65-8241-c6ab49154e71 1G Apr 21 20:55:37 devstack sudo[86966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:38 devstack sudo[86966]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4f24165-2e0e-47ec-994c-7092fb5e44c0 tempest-VolumesExtendTest-785278597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.b80448b0-86aa-4a65-8241-c6ab49154e71 1G" returned: 0 in 0.569s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4f24165-2e0e-47ec-994c-7092fb5e44c0 tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16848996-f5df-483d-95fa-9dc443afc1b6 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.b80448b0-86aa-4a65-8241-c6ab49154e71 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:38 devstack sudo[86973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16848996-f5df-483d-95fa-9dc443afc1b6 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.b80448b0-86aa-4a65-8241-c6ab49154e71 Apr 21 20:55:38 devstack sudo[86973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:38 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:38 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Flow 'volume_create_manager' (e7533c94-794a-470e-860d-1860eb4961eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:38 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5447a432-f202-4300-beab-bff1a90c8479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:38 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5447a432-f202-4300-beab-bff1a90c8479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-879314171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7668ae36-6856-43ef-bb06-bea4bcdf1d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8129f201a84614bf05b42dac0fc7e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=bae3330c-3b79-4001-97b6-f86582cfe2f9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:38Z,use_quota=True,user_id='a788217e50bb43b4a136c62bbe903817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:38 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a716b0-6e61-48a7-a7c8-6392fc9f8347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:38 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a716b0-6e61-48a7-a7c8-6392fc9f8347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:38 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5232c2e6-f325-4b4a-9620-309e72221604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:38 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5232c2e6-f325-4b4a-9620-309e72221604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7668ae36-6856-43ef-bb06-bea4bcdf1d1e', 'volume_name': 'volume-7668ae36-6856-43ef-bb06-bea4bcdf1d1e', 'volume_size': 2, 'snapshot_id': 'bae3330c-3b79-4001-97b6-f86582cfe2f9'}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:38 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c61cc2-be8b-4e9e-a8e1-bc7fdf9d99ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:38 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c61cc2-be8b-4e9e-a8e1-bc7fdf9d99ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:38 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8974111-be89-441d-88f3-101d6a71af8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:38 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Volume 7668ae36-6856-43ef-bb06-bea4bcdf1d1e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7668ae36-6856-43ef-bb06-bea4bcdf1d1e', 'volume_size': 2, 'snapshot_id': 'bae3330c-3b79-4001-97b6-f86582cfe2f9'} Apr 21 20:55:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:38 devstack sudo[86973]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4f24165-2e0e-47ec-994c-7092fb5e44c0 tempest-VolumesExtendTest-785278597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16848996-f5df-483d-95fa-9dc443afc1b6 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.b80448b0-86aa-4a65-8241-c6ab49154e71" returned: 0 in 0.603s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:38 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-a4f24165-2e0e-47ec-994c-7092fb5e44c0 tempest-VolumesExtendTest-785278597 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.b80448b0-86aa-4a65-8241-c6ab49154e71 is being set with open permissions: ugo+rw Apr 21 20:55:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4f24165-2e0e-47ec-994c-7092fb5e44c0 tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.b80448b0-86aa-4a65-8241-c6ab49154e71 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:38 devstack sudo[86985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.b80448b0-86aa-4a65-8241-c6ab49154e71 Apr 21 20:55:38 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:39 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4f24165-2e0e-47ec-994c-7092fb5e44c0 tempest-VolumesExtendTest-785278597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.b80448b0-86aa-4a65-8241-c6ab49154e71" returned: 0 in 0.470s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4f24165-2e0e-47ec-994c-7092fb5e44c0 tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:39 devstack sudo[86997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.info Apr 21 20:55:39 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:39 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4f24165-2e0e-47ec-994c-7092fb5e44c0 tempest-VolumesExtendTest-785278597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.info" returned: 0 in 0.519s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:39 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-a4f24165-2e0e-47ec-994c-7092fb5e44c0 tempest-VolumesExtendTest-785278597 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.info is being set with open permissions: ugo+rw Apr 21 20:55:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4f24165-2e0e-47ec-994c-7092fb5e44c0 tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:39 devstack sudo[87004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.info Apr 21 20:55:39 devstack sudo[87004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:40 devstack sudo[87004]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4f24165-2e0e-47ec-994c-7092fb5e44c0 tempest-VolumesExtendTest-785278597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.info" returned: 0 in 0.482s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a4f24165-2e0e-47ec-994c-7092fb5e44c0 tempest-VolumesExtendTest-785278597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.257s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.868s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "cinder-quobyte-bae3330c-3b79-4001-97b6-f86582cfe2f9-7668ae36-6856-43ef-bb06-bea4bcdf1d1e" by "_create_volume_from_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-bae3330c-3b79-4001-97b6-f86582cfe2f9-7668ae36-6856-43ef-bb06-bea4bcdf1d1e" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Creating volume 7668ae36-6856-43ef-bb06-bea4bcdf1d1e from snapshot bae3330c-3b79-4001-97b6-f86582cfe2f9 {{(pid=81957) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "cinder-quobyte-7668ae36-6856-43ef-bb06-bea4bcdf1d1e" by "_copy_volume_from_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-7668ae36-6856-43ef-bb06-bea4bcdf1d1e" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] snapshot: bae3330c-3b79-4001-97b6-f86582cfe2f9, volume: 7668ae36-6856-43ef-bb06-bea4bcdf1d1e, {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:40 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-a4f24165-2e0e-47ec-994c-7092fb5e44c0 tempest-VolumesExtendTest-785278597 None] Create snapshot completed successfully Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[8831478a-d302-4c01-9df0-358b5a86bab5]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.bae3330c-3b79-4001-97b6-f86582cfe2f9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:40 devstack sudo[87011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.bae3330c-3b79-4001-97b6-f86582cfe2f9 Apr 21 20:55:40 devstack sudo[87011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:40 devstack sudo[87011]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.bae3330c-3b79-4001-97b6-f86582cfe2f9" returned: 0 in 0.547s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d954bdba-6f7b-42a6-8998-7d7206a638e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Creating direct copy from snapshot {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfb72e1-7392-45b1-b0b4-e2636c4c8170]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:40 devstack sudo[87017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 Apr 21 20:55:40 devstack sudo[87017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a57bf934-b88f-47a9-8c25-410e3ce848a1 tempest-VolumesExtendTest-785278597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:41 devstack sudo[87017]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9" returned: 0 in 0.551s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:41 devstack cinder-volume[81957]: DEBUG cinder.utils [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Path /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7668ae36-6856-43ef-bb06-bea4bcdf1d1e not found in is_blk_device check {{(pid=81957) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:55:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7668ae36-6856-43ef-bb06-bea4bcdf1d1e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:41 devstack sudo[87025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7668ae36-6856-43ef-bb06-bea4bcdf1d1e Apr 21 20:55:41 devstack sudo[87025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:43 devstack sudo[87025]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7668ae36-6856-43ef-bb06-bea4bcdf1d1e" returned: 0 in 2.305s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:43 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e0c51d-c3c6-4340-ba67-9016150e0427]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:43 devstack sudo[87064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 Apr 21 20:55:43 devstack sudo[87064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:44 devstack sudo[87064]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9" returned: 0 in 0.731s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:44 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9, size 1024.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7668ae36-6856-43ef-bb06-bea4bcdf1d1e {{(pid=81957) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:55:44 devstack cinder-volume[81957]: INFO cinder.image.image_utils [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Converted 1024.00 MB image at 443.89 MB/s Apr 21 20:55:44 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7668ae36-6856-43ef-bb06-bea4bcdf1d1e is being set with open permissions: ugo+rw Apr 21 20:55:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7668ae36-6856-43ef-bb06-bea4bcdf1d1e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:44 devstack sudo[87070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7668ae36-6856-43ef-bb06-bea4bcdf1d1e Apr 21 20:55:44 devstack sudo[87070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:44 devstack sudo[87070]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7668ae36-6856-43ef-bb06-bea4bcdf1d1e" returned: 0 in 0.577s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:44 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-7668ae36-6856-43ef-bb06-bea4bcdf1d1e" released by "_copy_volume_from_snapshot" :: held 4.780s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:44 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-bae3330c-3b79-4001-97b6-f86582cfe2f9-7668ae36-6856-43ef-bb06-bea4bcdf1d1e" released by "_create_volume_from_snapshot" :: held 4.802s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.815s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a57bf934-b88f-47a9-8c25-410e3ce848a1 tempest-VolumesExtendTest-785278597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 3.838s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:44 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8c6b50-3804-4666-a232-dc1bfe08e5bd]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a57bf934-b88f-47a9-8c25-410e3ce848a1 tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8974111-be89-441d-88f3-101d6a71af8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7668ae36-6856-43ef-bb06-bea4bcdf1d1e', 'volume_size': 2, 'snapshot_id': 'bae3330c-3b79-4001-97b6-f86582cfe2f9'}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6a579f-7406-461e-95d3-cc1c0b1c8379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:45 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Volume volume-7668ae36-6856-43ef-bb06-bea4bcdf1d1e (7668ae36-6856-43ef-bb06-bea4bcdf1d1e): created successfully Apr 21 20:55:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6a579f-7406-461e-95d3-cc1c0b1c8379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Flow 'volume_create_manager' (e7533c94-794a-470e-860d-1860eb4961eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:45 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-45fb6db7-4bce-4103-b1e6-0f9a87afe6a0 tempest-VolumesSnapshotTestJSON-1313411673 None] Created volume successfully. Apr 21 20:55:45 devstack sudo[87074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6 Apr 21 20:55:45 devstack sudo[87074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:45 devstack sudo[87074]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a57bf934-b88f-47a9-8c25-410e3ce848a1 tempest-VolumesExtendTest-785278597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6" returned: 0 in 0.549s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a57bf934-b88f-47a9-8c25-410e3ce848a1 tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.b80448b0-86aa-4a65-8241-c6ab49154e71 2G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a57bf934-b88f-47a9-8c25-410e3ce848a1 tempest-VolumesExtendTest-785278597 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.b80448b0-86aa-4a65-8241-c6ab49154e71 2G" returned: 0 in 0.117s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a57bf934-b88f-47a9-8c25-410e3ce848a1 tempest-VolumesExtendTest-785278597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.691s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:45 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-a57bf934-b88f-47a9-8c25-410e3ce848a1 tempest-VolumesExtendTest-785278597 None] Extend volume completed successfully. Apr 21 20:55:45 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0434195f-aad6-4d17-9749-c9593252fac7 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "cinder-7668ae36-6856-43ef-bb06-bea4bcdf1d1e-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:45 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0434195f-aad6-4d17-9749-c9593252fac7 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-7668ae36-6856-43ef-bb06-bea4bcdf1d1e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:45 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0434195f-aad6-4d17-9749-c9593252fac7 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "cinder-quobyte-7668ae36-6856-43ef-bb06-bea4bcdf1d1e" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:45 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0434195f-aad6-4d17-9749-c9593252fac7 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-7668ae36-6856-43ef-bb06-bea4bcdf1d1e" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:46 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb44d6b3-105e-4722-9538-4313753057d6]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0434195f-aad6-4d17-9749-c9593252fac7 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7668ae36-6856-43ef-bb06-bea4bcdf1d1e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:46 devstack sudo[87090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7668ae36-6856-43ef-bb06-bea4bcdf1d1e Apr 21 20:55:46 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:46 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0434195f-aad6-4d17-9749-c9593252fac7 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7668ae36-6856-43ef-bb06-bea4bcdf1d1e" returned: 0 in 0.610s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0434195f-aad6-4d17-9749-c9593252fac7 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7668ae36-6856-43ef-bb06-bea4bcdf1d1e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:46 devstack sudo[87106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7668ae36-6856-43ef-bb06-bea4bcdf1d1e Apr 21 20:55:46 devstack sudo[87106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-064ccdc1-649e-48a2-bf23-4a0519620a8d tempest-VolumesExtendTest-785278597 None] Acquiring lock "cinder-b80448b0-86aa-4a65-8241-c6ab49154e71-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-064ccdc1-649e-48a2-bf23-4a0519620a8d tempest-VolumesExtendTest-785278597 None] Lock "cinder-b80448b0-86aa-4a65-8241-c6ab49154e71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-064ccdc1-649e-48a2-bf23-4a0519620a8d tempest-VolumesExtendTest-785278597 None] Acquiring lock "cinder-quobyte-16848996-f5df-483d-95fa-9dc443afc1b6" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-064ccdc1-649e-48a2-bf23-4a0519620a8d tempest-VolumesExtendTest-785278597 None] Lock "cinder-quobyte-16848996-f5df-483d-95fa-9dc443afc1b6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-064ccdc1-649e-48a2-bf23-4a0519620a8d tempest-VolumesExtendTest-785278597 None] Acquiring lock "cinder-quobyte-b80448b0-86aa-4a65-8241-c6ab49154e71" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-064ccdc1-649e-48a2-bf23-4a0519620a8d tempest-VolumesExtendTest-785278597 None] Lock "cinder-quobyte-b80448b0-86aa-4a65-8241-c6ab49154e71" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-064ccdc1-649e-48a2-bf23-4a0519620a8d tempest-VolumesExtendTest-785278597 None] Deleting offline snapshot b80448b0-86aa-4a65-8241-c6ab49154e71 of volume 16848996-f5df-483d-95fa-9dc443afc1b6 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:55:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-064ccdc1-649e-48a2-bf23-4a0519620a8d tempest-VolumesExtendTest-785278597 None] snapshot_file for this snap is: volume-16848996-f5df-483d-95fa-9dc443afc1b6.b80448b0-86aa-4a65-8241-c6ab49154e71 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:55:46 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[840029c2-94a1-4751-99a8-62b49c307bd9]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-064ccdc1-649e-48a2-bf23-4a0519620a8d tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.b80448b0-86aa-4a65-8241-c6ab49154e71 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:47 devstack sudo[87112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.b80448b0-86aa-4a65-8241-c6ab49154e71 Apr 21 20:55:47 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a1ccf582-688b-49d5-9222-2a8f2d76fbf8 tempest-VolumesActionsTest-541426287 None] Acquiring lock "cinder-a0e53625-e51c-4981-b33b-aaf9b4587db7" by "attach_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a1ccf582-688b-49d5-9222-2a8f2d76fbf8 tempest-VolumesActionsTest-541426287 None] Lock "cinder-a0e53625-e51c-4981-b33b-aaf9b4587db7" acquired by "attach_volume" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:47 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-a1ccf582-688b-49d5-9222-2a8f2d76fbf8 tempest-VolumesActionsTest-541426287 None] Attaching volume a0e53625-e51c-4981-b33b-aaf9b4587db7 to instance 8c9c49bf-674f-48b6-b05f-d6ae0f6e2776 at mountpoint /dev/vdb on host None. Apr 21 20:55:47 devstack sudo[87106]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:47 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-a1ccf582-688b-49d5-9222-2a8f2d76fbf8 tempest-VolumesActionsTest-541426287 None] Attach volume completed successfully. Apr 21 20:55:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0434195f-aad6-4d17-9749-c9593252fac7 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7668ae36-6856-43ef-bb06-bea4bcdf1d1e" returned: 0 in 1.051s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a1ccf582-688b-49d5-9222-2a8f2d76fbf8 tempest-VolumesActionsTest-541426287 None] Lock "cinder-a0e53625-e51c-4981-b33b-aaf9b4587db7" released by "attach_volume" :: held 0.166s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0434195f-aad6-4d17-9749-c9593252fac7 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-7668ae36-6856-43ef-bb06-bea4bcdf1d1e" released by "delete_volume" :: held 1.703s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:47 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-0434195f-aad6-4d17-9749-c9593252fac7 tempest-VolumesSnapshotTestJSON-1313411673 None] Created reservations ['34bcce65-38b2-466b-9d29-213e209713f9', '47bbd1f7-cd10-4030-99cd-8b3d079801f9', '1b4e74a8-c3ba-4bea-86e7-4549a3586acc', '19df0ba3-7732-4a34-880e-6deb4ac5d393'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:47 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0434195f-aad6-4d17-9749-c9593252fac7 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0434195f-aad6-4d17-9749-c9593252fac7 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0434195f-aad6-4d17-9749-c9593252fac7 tempest-VolumesSnapshotTestJSON-1313411673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0434195f-aad6-4d17-9749-c9593252fac7 tempest-VolumesSnapshotTestJSON-1313411673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0434195f-aad6-4d17-9749-c9593252fac7 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0434195f-aad6-4d17-9749-c9593252fac7 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-064ccdc1-649e-48a2-bf23-4a0519620a8d tempest-VolumesExtendTest-785278597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.b80448b0-86aa-4a65-8241-c6ab49154e71" returned: 0 in 0.959s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-064ccdc1-649e-48a2-bf23-4a0519620a8d tempest-VolumesExtendTest-785278597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16848996-f5df-483d-95fa-9dc443afc1b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:55:47 devstack sudo[87121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:55:47 devstack sudo[87121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:47 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[87297f35-cc4a-4aea-8e72-9f32dde58e23]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-064ccdc1-649e-48a2-bf23-4a0519620a8d tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:48 devstack sudo[87123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6 Apr 21 20:55:48 devstack sudo[87123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:48 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-d316bd7d-234f-4881-b93d-18bc874e7886 tempest-VolumesActionsTest-541426287 None] Acquiring lock "cinder-a0e53625-e51c-4981-b33b-aaf9b4587db7-detach_volume" by "detach_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:48 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-d316bd7d-234f-4881-b93d-18bc874e7886 tempest-VolumesActionsTest-541426287 None] Lock "cinder-a0e53625-e51c-4981-b33b-aaf9b4587db7-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:48 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-d316bd7d-234f-4881-b93d-18bc874e7886 tempest-VolumesActionsTest-541426287 None] Detaching volume a0e53625-e51c-4981-b33b-aaf9b4587db7 from instance 8c9c49bf-674f-48b6-b05f-d6ae0f6e2776. Apr 21 20:55:48 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-d316bd7d-234f-4881-b93d-18bc874e7886 tempest-VolumesActionsTest-541426287 None] Detach volume completed successfully. Apr 21 20:55:48 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-d316bd7d-234f-4881-b93d-18bc874e7886 tempest-VolumesActionsTest-541426287 None] Lock "cinder-a0e53625-e51c-4981-b33b-aaf9b4587db7-detach_volume" released by "detach_volume" :: held 0.089s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:48 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bc884a3f-7521-4648-81db-9a8aef7332f5 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "cinder-bae3330c-3b79-4001-97b6-f86582cfe2f9-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:48 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bc884a3f-7521-4648-81db-9a8aef7332f5 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-bae3330c-3b79-4001-97b6-f86582cfe2f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:48 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bc884a3f-7521-4648-81db-9a8aef7332f5 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "cinder-quobyte-d954bdba-6f7b-42a6-8998-7d7206a638e9" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:48 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bc884a3f-7521-4648-81db-9a8aef7332f5 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-d954bdba-6f7b-42a6-8998-7d7206a638e9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:48 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bc884a3f-7521-4648-81db-9a8aef7332f5 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "cinder-quobyte-bae3330c-3b79-4001-97b6-f86582cfe2f9" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:48 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bc884a3f-7521-4648-81db-9a8aef7332f5 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-bae3330c-3b79-4001-97b6-f86582cfe2f9" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:48 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-bc884a3f-7521-4648-81db-9a8aef7332f5 tempest-VolumesSnapshotTestJSON-1313411673 None] Deleting offline snapshot bae3330c-3b79-4001-97b6-f86582cfe2f9 of volume d954bdba-6f7b-42a6-8998-7d7206a638e9 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:55:48 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-bc884a3f-7521-4648-81db-9a8aef7332f5 tempest-VolumesSnapshotTestJSON-1313411673 None] snapshot_file for this snap is: volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.bae3330c-3b79-4001-97b6-f86582cfe2f9 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:55:48 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26e2dbe-6280-4ea8-bd73-ea5aeec2f69c]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bc884a3f-7521-4648-81db-9a8aef7332f5 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.bae3330c-3b79-4001-97b6-f86582cfe2f9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:48 devstack sudo[87127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.bae3330c-3b79-4001-97b6-f86582cfe2f9 Apr 21 20:55:48 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:48 devstack sudo[87121]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0434195f-aad6-4d17-9749-c9593252fac7 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.943s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:48 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-0434195f-aad6-4d17-9749-c9593252fac7 tempest-VolumesSnapshotTestJSON-1313411673 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:48 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-0434195f-aad6-4d17-9749-c9593252fac7 tempest-VolumesSnapshotTestJSON-1313411673 None] Deleted volume successfully. Apr 21 20:55:48 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0434195f-aad6-4d17-9749-c9593252fac7 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-7668ae36-6856-43ef-bb06-bea4bcdf1d1e-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:48 devstack sudo[87123]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-064ccdc1-649e-48a2-bf23-4a0519620a8d tempest-VolumesExtendTest-785278597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6" returned: 0 in 1.015s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-064ccdc1-649e-48a2-bf23-4a0519620a8d tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.b80448b0-86aa-4a65-8241-c6ab49154e71 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:48 devstack sudo[87147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.b80448b0-86aa-4a65-8241-c6ab49154e71 Apr 21 20:55:48 devstack sudo[87147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:49 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bc884a3f-7521-4648-81db-9a8aef7332f5 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.bae3330c-3b79-4001-97b6-f86582cfe2f9" returned: 0 in 1.046s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:49 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-bc884a3f-7521-4648-81db-9a8aef7332f5 tempest-VolumesSnapshotTestJSON-1313411673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d954bdba-6f7b-42a6-8998-7d7206a638e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:55:49 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c91720-d22e-439e-89b1-bc3254528334]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bc884a3f-7521-4648-81db-9a8aef7332f5 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:49 devstack sudo[87158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 Apr 21 20:55:49 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:49 devstack sudo[87147]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-064ccdc1-649e-48a2-bf23-4a0519620a8d tempest-VolumesExtendTest-785278597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.b80448b0-86aa-4a65-8241-c6ab49154e71" returned: 0 in 0.664s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-064ccdc1-649e-48a2-bf23-4a0519620a8d tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.b80448b0-86aa-4a65-8241-c6ab49154e71 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:49 devstack sudo[87163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.b80448b0-86aa-4a65-8241-c6ab49154e71 Apr 21 20:55:49 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:49 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bc884a3f-7521-4648-81db-9a8aef7332f5 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9" returned: 0 in 0.483s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bc884a3f-7521-4648-81db-9a8aef7332f5 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.bae3330c-3b79-4001-97b6-f86582cfe2f9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:49 devstack sudo[87168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.bae3330c-3b79-4001-97b6-f86582cfe2f9 Apr 21 20:55:49 devstack sudo[87168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:49 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-064ccdc1-649e-48a2-bf23-4a0519620a8d tempest-VolumesExtendTest-785278597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6.b80448b0-86aa-4a65-8241-c6ab49154e71" returned: 0 in 0.433s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:50 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-064ccdc1-649e-48a2-bf23-4a0519620a8d tempest-VolumesExtendTest-785278597 None] Lock "cinder-quobyte-b80448b0-86aa-4a65-8241-c6ab49154e71" released by "_delete_snapshot" :: held 3.187s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:50 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-064ccdc1-649e-48a2-bf23-4a0519620a8d tempest-VolumesExtendTest-785278597 None] Lock "cinder-quobyte-16848996-f5df-483d-95fa-9dc443afc1b6" released by "delete_snapshot" :: held 3.227s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:50 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-064ccdc1-649e-48a2-bf23-4a0519620a8d tempest-VolumesExtendTest-785278597 None] Created reservations ['f5e63125-c44c-42cd-9e77-6a7566fc1315', '02384c5d-9a38-44d5-974e-c2127610154f', 'a89f0c0c-462c-4376-9d86-f9e402bcea16', '3bc32d69-b04a-41f8-9448-bf854c566c91'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:50 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-064ccdc1-649e-48a2-bf23-4a0519620a8d tempest-VolumesExtendTest-785278597 None] Delete snapshot completed successfully. Apr 21 20:55:50 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-064ccdc1-649e-48a2-bf23-4a0519620a8d tempest-VolumesExtendTest-785278597 None] Lock "cinder-b80448b0-86aa-4a65-8241-c6ab49154e71-delete_snapshot" released by "delete_snapshot" :: held 3.503s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:50 devstack sudo[87168]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bc884a3f-7521-4648-81db-9a8aef7332f5 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.bae3330c-3b79-4001-97b6-f86582cfe2f9" returned: 0 in 0.896s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bc884a3f-7521-4648-81db-9a8aef7332f5 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.bae3330c-3b79-4001-97b6-f86582cfe2f9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:50 devstack sudo[87234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.bae3330c-3b79-4001-97b6-f86582cfe2f9 Apr 21 20:55:50 devstack sudo[87234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-60af587d-3e7c-46db-9e9e-8bcca0e5da61 tempest-VolumesExtendTest-785278597 None] Acquiring lock "cinder-16848996-f5df-483d-95fa-9dc443afc1b6-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-60af587d-3e7c-46db-9e9e-8bcca0e5da61 tempest-VolumesExtendTest-785278597 None] Lock "cinder-16848996-f5df-483d-95fa-9dc443afc1b6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-60af587d-3e7c-46db-9e9e-8bcca0e5da61 tempest-VolumesExtendTest-785278597 None] Acquiring lock "cinder-quobyte-16848996-f5df-483d-95fa-9dc443afc1b6" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-60af587d-3e7c-46db-9e9e-8bcca0e5da61 tempest-VolumesExtendTest-785278597 None] Lock "cinder-quobyte-16848996-f5df-483d-95fa-9dc443afc1b6" acquired by "delete_volume" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:51 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae3f897-1045-4519-a65b-611b546aa613]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60af587d-3e7c-46db-9e9e-8bcca0e5da61 tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:51 devstack sudo[87238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6 Apr 21 20:55:51 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:51 devstack sudo[87234]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bc884a3f-7521-4648-81db-9a8aef7332f5 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9.bae3330c-3b79-4001-97b6-f86582cfe2f9" returned: 0 in 0.477s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bc884a3f-7521-4648-81db-9a8aef7332f5 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-bae3330c-3b79-4001-97b6-f86582cfe2f9" released by "_delete_snapshot" :: held 2.963s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bc884a3f-7521-4648-81db-9a8aef7332f5 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-d954bdba-6f7b-42a6-8998-7d7206a638e9" released by "delete_snapshot" :: held 2.981s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:51 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-bc884a3f-7521-4648-81db-9a8aef7332f5 tempest-VolumesSnapshotTestJSON-1313411673 None] Created reservations ['93619420-45aa-469e-b519-4f18144a1a47', '51cb1944-edd5-416a-8ecd-2dfeb8c72cde', '028f010b-d9b4-41d5-9b65-769c287e117a', '6d84a73b-d299-48c2-ad02-15933665c6c8'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:51 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-bc884a3f-7521-4648-81db-9a8aef7332f5 tempest-VolumesSnapshotTestJSON-1313411673 None] Delete snapshot completed successfully. Apr 21 20:55:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bc884a3f-7521-4648-81db-9a8aef7332f5 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-bae3330c-3b79-4001-97b6-f86582cfe2f9-delete_snapshot" released by "delete_snapshot" :: held 3.073s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0b74911a-4ce8-4aa2-93fb-cd3c7cbe6c18 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "cinder-d954bdba-6f7b-42a6-8998-7d7206a638e9-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0b74911a-4ce8-4aa2-93fb-cd3c7cbe6c18 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-d954bdba-6f7b-42a6-8998-7d7206a638e9-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0b74911a-4ce8-4aa2-93fb-cd3c7cbe6c18 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "cinder-quobyte-d954bdba-6f7b-42a6-8998-7d7206a638e9" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0b74911a-4ce8-4aa2-93fb-cd3c7cbe6c18 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-d954bdba-6f7b-42a6-8998-7d7206a638e9" acquired by "delete_volume" :: waited 0.016s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:51 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20df5f5-b704-40ab-8cdf-bef45107fd0f]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0b74911a-4ce8-4aa2-93fb-cd3c7cbe6c18 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:51 devstack sudo[87243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 Apr 21 20:55:51 devstack sudo[87243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:51 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60af587d-3e7c-46db-9e9e-8bcca0e5da61 tempest-VolumesExtendTest-785278597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6" returned: 0 in 0.586s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60af587d-3e7c-46db-9e9e-8bcca0e5da61 tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:51 devstack sudo[87248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6 Apr 21 20:55:51 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:52 devstack sudo[87243]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0b74911a-4ce8-4aa2-93fb-cd3c7cbe6c18 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9" returned: 0 in 0.552s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0b74911a-4ce8-4aa2-93fb-cd3c7cbe6c18 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:52 devstack sudo[87259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9 Apr 21 20:55:52 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:52 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60af587d-3e7c-46db-9e9e-8bcca0e5da61 tempest-VolumesExtendTest-785278597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-16848996-f5df-483d-95fa-9dc443afc1b6" returned: 0 in 0.447s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-60af587d-3e7c-46db-9e9e-8bcca0e5da61 tempest-VolumesExtendTest-785278597 None] Lock "cinder-quobyte-16848996-f5df-483d-95fa-9dc443afc1b6" released by "delete_volume" :: held 1.061s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:52 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-60af587d-3e7c-46db-9e9e-8bcca0e5da61 tempest-VolumesExtendTest-785278597 None] Created reservations ['210c4aff-1da4-43e8-8e75-573ef6421c19', 'dbe4bb6d-c1c4-4b9a-8f1f-60c860a74adc', 'df91fc52-b116-4f6a-9edb-68844c832b31', '4ca238e2-478f-4d84-ae8a-228b9a63c943'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-60af587d-3e7c-46db-9e9e-8bcca0e5da61 tempest-VolumesExtendTest-785278597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-60af587d-3e7c-46db-9e9e-8bcca0e5da61 tempest-VolumesExtendTest-785278597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:52 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-60af587d-3e7c-46db-9e9e-8bcca0e5da61 tempest-VolumesExtendTest-785278597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:52 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-60af587d-3e7c-46db-9e9e-8bcca0e5da61 tempest-VolumesExtendTest-785278597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-60af587d-3e7c-46db-9e9e-8bcca0e5da61 tempest-VolumesExtendTest-785278597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60af587d-3e7c-46db-9e9e-8bcca0e5da61 tempest-VolumesExtendTest-785278597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:52 devstack sudo[87261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:55:52 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:52 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0b74911a-4ce8-4aa2-93fb-cd3c7cbe6c18 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d954bdba-6f7b-42a6-8998-7d7206a638e9" returned: 0 in 0.433s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0b74911a-4ce8-4aa2-93fb-cd3c7cbe6c18 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-d954bdba-6f7b-42a6-8998-7d7206a638e9" released by "delete_volume" :: held 1.023s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:52 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-0b74911a-4ce8-4aa2-93fb-cd3c7cbe6c18 tempest-VolumesSnapshotTestJSON-1313411673 None] Created reservations ['6496f25f-f085-45a7-a665-5a9a8d960305', '0d93063c-02dd-4fa2-9c4a-c0f4f7bc6608', '9c581bbb-3a53-43df-85fe-16034d454b8b', 'b3e091fc-03ac-43a5-894a-ff4177491173'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0b74911a-4ce8-4aa2-93fb-cd3c7cbe6c18 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0b74911a-4ce8-4aa2-93fb-cd3c7cbe6c18 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:52 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0b74911a-4ce8-4aa2-93fb-cd3c7cbe6c18 tempest-VolumesSnapshotTestJSON-1313411673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:52 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0b74911a-4ce8-4aa2-93fb-cd3c7cbe6c18 tempest-VolumesSnapshotTestJSON-1313411673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0b74911a-4ce8-4aa2-93fb-cd3c7cbe6c18 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0b74911a-4ce8-4aa2-93fb-cd3c7cbe6c18 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:52 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-60af587d-3e7c-46db-9e9e-8bcca0e5da61 tempest-VolumesExtendTest-785278597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.458s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:52 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-60af587d-3e7c-46db-9e9e-8bcca0e5da61 tempest-VolumesExtendTest-785278597 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:52 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-60af587d-3e7c-46db-9e9e-8bcca0e5da61 tempest-VolumesExtendTest-785278597 None] Deleted volume successfully. Apr 21 20:55:52 devstack sudo[87267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:55:52 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-60af587d-3e7c-46db-9e9e-8bcca0e5da61 tempest-VolumesExtendTest-785278597 None] Lock "cinder-16848996-f5df-483d-95fa-9dc443afc1b6-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:53 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0b74911a-4ce8-4aa2-93fb-cd3c7cbe6c18 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.567s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:53 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-0b74911a-4ce8-4aa2-93fb-cd3c7cbe6c18 tempest-VolumesSnapshotTestJSON-1313411673 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:53 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-0b74911a-4ce8-4aa2-93fb-cd3c7cbe6c18 tempest-VolumesSnapshotTestJSON-1313411673 None] Deleted volume successfully. Apr 21 20:55:53 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0b74911a-4ce8-4aa2-93fb-cd3c7cbe6c18 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-d954bdba-6f7b-42a6-8998-7d7206a638e9-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:53 devstack cinder-volume[81957]: DEBUG oslo_service.periodic_task [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81957) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:55:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:53 devstack sudo[87293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:55:53 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Flow 'volume_create_manager' (1610a775-5bab-406c-aa25-27487bcf03e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359d776b-405a-4aec-a75b-3618dda40886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359d776b-405a-4aec-a75b-3618dda40886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1230757250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab9fb624-4421-40ba-b512-a668c19378d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8129f201a84614bf05b42dac0fc7e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:54Z,use_quota=True,user_id='a788217e50bb43b4a136c62bbe903817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a882489e-318c-4bdd-becd-92fa71ba406b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a882489e-318c-4bdd-becd-92fa71ba406b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb9cc87-10a1-41b6-8c19-82dd8309e453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb9cc87-10a1-41b6-8c19-82dd8309e453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab9fb624-4421-40ba-b512-a668c19378d3', 'volume_name': 'volume-ab9fb624-4421-40ba-b512-a668c19378d3', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a4cc883-7cbe-4d67-a8d5-d944b3f76c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a4cc883-7cbe-4d67-a8d5-d944b3f76c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7d06f1-eaab-4bb8-95cc-60150a0c6002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:54 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Volume ab9fb624-4421-40ba-b512-a668c19378d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab9fb624-4421-40ba-b512-a668c19378d3', 'volume_size': 1} Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1230757250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab9fb624-4421-40ba-b512-a668c19378d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8129f201a84614bf05b42dac0fc7e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:54Z,use_quota=True,user_id='a788217e50bb43b4a136c62bbe903817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Creating volume ab9fb624-4421-40ba-b512-a668c19378d3 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:54 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:54 devstack sudo[87297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3 1073741824 Apr 21 20:55:54 devstack sudo[87297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:54 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 1.032s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:54 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:55 devstack sudo[87297]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3 1073741824" returned: 0 in 1.240s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:55 devstack sudo[87338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3 Apr 21 20:55:55 devstack sudo[87338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Flow 'volume_create_manager' (7f8bd737-7c8f-4537-9f8b-0ef01b1b14cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e732d800-322c-4b1a-9150-165d438f2626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:56 devstack sudo[87338]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e732d800-322c-4b1a-9150-165d438f2626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1578678385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75870e9-85ff-4685-a668-52c2d227444d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4289da88b9a0409dac1de908352bbc57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:57Z,use_quota=True,user_id='aa2fd890ddbd4389b9da649ed74e5892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703669fe-b7bb-43d9-9b8f-3f3a50649c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703669fe-b7bb-43d9-9b8f-3f3a50649c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5040b1-401a-4440-8170-1462ebe0dda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5040b1-401a-4440-8170-1462ebe0dda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b75870e9-85ff-4685-a668-52c2d227444d', 'volume_name': 'volume-b75870e9-85ff-4685-a668-52c2d227444d', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f7a8d4-0362-4cc1-805f-f4e01e494eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f7a8d4-0362-4cc1-805f-f4e01e494eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb64e07f-b669-4203-aa52-f446fc160bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:56 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Volume b75870e9-85ff-4685-a668-52c2d227444d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b75870e9-85ff-4685-a668-52c2d227444d', 'volume_size': 1} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3" returned: 0 in 0.871s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] <== create_volume: return (2157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.160s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1578678385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75870e9-85ff-4685-a668-52c2d227444d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4289da88b9a0409dac1de908352bbc57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:57Z,use_quota=True,user_id='aa2fd890ddbd4389b9da649ed74e5892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Creating volume b75870e9-85ff-4685-a668-52c2d227444d {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:56 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b75870e9-85ff-4685-a668-52c2d227444d 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7d06f1-eaab-4bb8-95cc-60150a0c6002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab9fb624-4421-40ba-b512-a668c19378d3', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:56 devstack sudo[87344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b75870e9-85ff-4685-a668-52c2d227444d 1073741824 Apr 21 20:55:56 devstack sudo[87344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb7cfcb-cca1-4e92-8dc7-1ca855ace562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:56 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Volume volume-ab9fb624-4421-40ba-b512-a668c19378d3 (ab9fb624-4421-40ba-b512-a668c19378d3): created successfully Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb7cfcb-cca1-4e92-8dc7-1ca855ace562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Flow 'volume_create_manager' (1610a775-5bab-406c-aa25-27487bcf03e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:56 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-407c588e-e19c-4e35-81bd-05da88ab16f2 tempest-VolumesSnapshotTestJSON-1313411673 None] Created volume successfully. Apr 21 20:55:57 devstack sudo[87344]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b75870e9-85ff-4685-a668-52c2d227444d 1073741824" returned: 0 in 0.631s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b75870e9-85ff-4685-a668-52c2d227444d {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:57 devstack sudo[87351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b75870e9-85ff-4685-a668-52c2d227444d Apr 21 20:55:57 devstack sudo[87351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5c10712a-68aa-4407-a5b9-e316fcd3cb6a tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:57 devstack sudo[87351]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b75870e9-85ff-4685-a668-52c2d227444d" returned: 0 in 0.562s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:57 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5c10712a-68aa-4407-a5b9-e316fcd3cb6a tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.051s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb64e07f-b669-4203-aa52-f446fc160bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b75870e9-85ff-4685-a668-52c2d227444d', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d5bf892-6f97-4a4d-9f1f-fd74e35df519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-5c10712a-68aa-4407-a5b9-e316fcd3cb6a tempest-VolumesSnapshotTestJSON-1313411673 None] Creating offline snapshot 9503a089-9f42-4d68-a8a9-145d18b81213 of volume ab9fb624-4421-40ba-b512-a668c19378d3 {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:55:58 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Volume volume-b75870e9-85ff-4685-a668-52c2d227444d (b75870e9-85ff-4685-a668-52c2d227444d): created successfully Apr 21 20:55:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d5bf892-6f97-4a4d-9f1f-fd74e35df519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Flow 'volume_create_manager' (7f8bd737-7c8f-4537-9f8b-0ef01b1b14cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:58 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f9b92f-662c-450a-b622-14318e4eaf7b]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5c10712a-68aa-4407-a5b9-e316fcd3cb6a tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:58 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-ddf1e10c-307e-46d2-9757-ccefd2f5bff7 tempest-VolumesGetTest-967003488 None] Created volume successfully. Apr 21 20:55:58 devstack sudo[87354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3 Apr 21 20:55:58 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:58 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5c10712a-68aa-4407-a5b9-e316fcd3cb6a tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3" returned: 0 in 0.576s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5c10712a-68aa-4407-a5b9-e316fcd3cb6a tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.9503a089-9f42-4d68-a8a9-145d18b81213 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:58 devstack sudo[87359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.9503a089-9f42-4d68-a8a9-145d18b81213 1G Apr 21 20:55:58 devstack sudo[87359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:59 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Flow 'volume_create_manager' (28a0704c-6bda-4341-ae09-3fd655698816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0748012b-a5dd-4f4d-9eb9-f0a1eeb8887a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:59 devstack sudo[87359]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0748012b-a5dd-4f4d-9eb9-f0a1eeb8887a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1301593741',display_name='tempest-VolumesGetTest-Volume-508890726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=492aa3ae-591f-4ed1-9989-52f27174242a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4289da88b9a0409dac1de908352bbc57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:59Z,use_quota=True,user_id='aa2fd890ddbd4389b9da649ed74e5892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3544b163-6155-4e46-bfa7-32fbcdc8b11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3544b163-6155-4e46-bfa7-32fbcdc8b11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c17ec3-9f6a-4982-8e88-952901b05d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c17ec3-9f6a-4982-8e88-952901b05d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '492aa3ae-591f-4ed1-9989-52f27174242a', 'volume_name': 'volume-492aa3ae-591f-4ed1-9989-52f27174242a', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec3562a-364b-4033-8058-8685d72b6b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec3562a-364b-4033-8058-8685d72b6b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6864355-b93c-4573-ba8a-181e874b5ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:59 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Volume 492aa3ae-591f-4ed1-9989-52f27174242a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-492aa3ae-591f-4ed1-9989-52f27174242a', 'volume_size': 1} Apr 21 20:55:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5c10712a-68aa-4407-a5b9-e316fcd3cb6a tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.9503a089-9f42-4d68-a8a9-145d18b81213 1G" returned: 0 in 0.870s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5c10712a-68aa-4407-a5b9-e316fcd3cb6a tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab9fb624-4421-40ba-b512-a668c19378d3 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.9503a089-9f42-4d68-a8a9-145d18b81213 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:59 devstack sudo[87365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab9fb624-4421-40ba-b512-a668c19378d3 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.9503a089-9f42-4d68-a8a9-145d18b81213 Apr 21 20:55:59 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:00 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5c10712a-68aa-4407-a5b9-e316fcd3cb6a tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab9fb624-4421-40ba-b512-a668c19378d3 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.9503a089-9f42-4d68-a8a9-145d18b81213" returned: 0 in 0.543s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:00 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-5c10712a-68aa-4407-a5b9-e316fcd3cb6a tempest-VolumesSnapshotTestJSON-1313411673 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.9503a089-9f42-4d68-a8a9-145d18b81213 is being set with open permissions: ugo+rw Apr 21 20:56:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5c10712a-68aa-4407-a5b9-e316fcd3cb6a tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.9503a089-9f42-4d68-a8a9-145d18b81213 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:00 devstack sudo[87370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.9503a089-9f42-4d68-a8a9-145d18b81213 Apr 21 20:56:00 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:00 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5c10712a-68aa-4407-a5b9-e316fcd3cb6a tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.9503a089-9f42-4d68-a8a9-145d18b81213" returned: 0 in 0.459s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5c10712a-68aa-4407-a5b9-e316fcd3cb6a tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:00 devstack sudo[87373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.info Apr 21 20:56:00 devstack sudo[87373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:01 devstack sudo[87373]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5c10712a-68aa-4407-a5b9-e316fcd3cb6a tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.info" returned: 0 in 0.632s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:01 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-5c10712a-68aa-4407-a5b9-e316fcd3cb6a tempest-VolumesSnapshotTestJSON-1313411673 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.info is being set with open permissions: ugo+rw Apr 21 20:56:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5c10712a-68aa-4407-a5b9-e316fcd3cb6a tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:01 devstack sudo[87402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.info Apr 21 20:56:01 devstack sudo[87402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:01 devstack sudo[87402]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5c10712a-68aa-4407-a5b9-e316fcd3cb6a tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.info" returned: 0 in 0.665s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5c10712a-68aa-4407-a5b9-e316fcd3cb6a tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.833s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.353s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1301593741',display_name='tempest-VolumesGetTest-Volume-508890726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=492aa3ae-591f-4ed1-9989-52f27174242a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4289da88b9a0409dac1de908352bbc57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:59Z,use_quota=True,user_id='aa2fd890ddbd4389b9da649ed74e5892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Creating volume 492aa3ae-591f-4ed1-9989-52f27174242a {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:01 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:56:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-492aa3ae-591f-4ed1-9989-52f27174242a 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:01 devstack sudo[87407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-492aa3ae-591f-4ed1-9989-52f27174242a 1073741824 Apr 21 20:56:01 devstack sudo[87407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:01 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-5c10712a-68aa-4407-a5b9-e316fcd3cb6a tempest-VolumesSnapshotTestJSON-1313411673 None] Create snapshot completed successfully Apr 21 20:56:02 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:02 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Flow 'volume_create_manager' (1c16a2df-4a17-444b-8390-1db8fa66effe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:02 devstack sudo[87407]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:02 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee71f92b-d961-4005-8c5c-8ea0e9b5173b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-492aa3ae-591f-4ed1-9989-52f27174242a 1073741824" returned: 0 in 0.808s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:02 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee71f92b-d961-4005-8c5c-8ea0e9b5173b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1416159101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f67a255-f3f8-456e-9eae-cfc20a008516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8129f201a84614bf05b42dac0fc7e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9503a089-9f42-4d68-a8a9-145d18b81213,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:03Z,use_quota=True,user_id='a788217e50bb43b4a136c62bbe903817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:02 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb576655-6256-468a-95c1-7b2d399c0f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:02 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb576655-6256-468a-95c1-7b2d399c0f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:02 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802bb4a3-9943-470c-b022-4f11a9c394b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:02 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802bb4a3-9943-470c-b022-4f11a9c394b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0f67a255-f3f8-456e-9eae-cfc20a008516', 'volume_name': 'volume-0f67a255-f3f8-456e-9eae-cfc20a008516', 'volume_size': 1, 'snapshot_id': '9503a089-9f42-4d68-a8a9-145d18b81213'}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:02 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f7a91a-1b59-49ac-954f-d3e6ff338f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:02 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f7a91a-1b59-49ac-954f-d3e6ff338f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:02 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e72eb5d-cb15-4913-ae01-9e3ae9656865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:02 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Volume 0f67a255-f3f8-456e-9eae-cfc20a008516: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0f67a255-f3f8-456e-9eae-cfc20a008516', 'volume_size': 1, 'snapshot_id': '9503a089-9f42-4d68-a8a9-145d18b81213'} Apr 21 20:56:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-492aa3ae-591f-4ed1-9989-52f27174242a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:02 devstack sudo[87419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-492aa3ae-591f-4ed1-9989-52f27174242a Apr 21 20:56:02 devstack sudo[87419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:03 devstack sudo[87419]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-492aa3ae-591f-4ed1-9989-52f27174242a" returned: 0 in 0.462s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.477s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "cinder-quobyte-9503a089-9f42-4d68-a8a9-145d18b81213-0f67a255-f3f8-456e-9eae-cfc20a008516" by "_create_volume_from_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6864355-b93c-4573-ba8a-181e874b5ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-492aa3ae-591f-4ed1-9989-52f27174242a', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11628a8d-25fe-437c-993f-7807c1d4d57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-9503a089-9f42-4d68-a8a9-145d18b81213-0f67a255-f3f8-456e-9eae-cfc20a008516" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Creating volume 0f67a255-f3f8-456e-9eae-cfc20a008516 from snapshot 9503a089-9f42-4d68-a8a9-145d18b81213 {{(pid=81957) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "cinder-quobyte-0f67a255-f3f8-456e-9eae-cfc20a008516" by "_copy_volume_from_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-0f67a255-f3f8-456e-9eae-cfc20a008516" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] snapshot: 9503a089-9f42-4d68-a8a9-145d18b81213, volume: 0f67a255-f3f8-456e-9eae-cfc20a008516, {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:56:03 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Volume volume-492aa3ae-591f-4ed1-9989-52f27174242a (492aa3ae-591f-4ed1-9989-52f27174242a): created successfully Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11628a8d-25fe-437c-993f-7807c1d4d57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Flow 'volume_create_manager' (28a0704c-6bda-4341-ae09-3fd655698816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:03 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-8bac109a-467d-4246-bb9d-50f63263f9b0 tempest-VolumesGetTest-967003488 None] Created volume successfully. Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[7477b1e0-96fd-4f4e-bd13-65c88aa76091]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.9503a089-9f42-4d68-a8a9-145d18b81213 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:03 devstack sudo[87437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.9503a089-9f42-4d68-a8a9-145d18b81213 Apr 21 20:56:03 devstack sudo[87437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:03 devstack sudo[87437]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.9503a089-9f42-4d68-a8a9-145d18b81213" returned: 0 in 0.515s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab9fb624-4421-40ba-b512-a668c19378d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3 {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Creating direct copy from snapshot {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4df0174-1e1b-4209-a9ef-fcf0eab5427b]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:03 devstack sudo[87442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3 Apr 21 20:56:03 devstack sudo[87442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-de06165a-3894-413f-8f7b-eb46531d4cff tempest-VolumesGetTest-967003488 None] Acquiring lock "cinder-492aa3ae-591f-4ed1-9989-52f27174242a-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-de06165a-3894-413f-8f7b-eb46531d4cff tempest-VolumesGetTest-967003488 None] Lock "cinder-492aa3ae-591f-4ed1-9989-52f27174242a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-de06165a-3894-413f-8f7b-eb46531d4cff tempest-VolumesGetTest-967003488 None] Acquiring lock "cinder-quobyte-492aa3ae-591f-4ed1-9989-52f27174242a" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-de06165a-3894-413f-8f7b-eb46531d4cff tempest-VolumesGetTest-967003488 None] Lock "cinder-quobyte-492aa3ae-591f-4ed1-9989-52f27174242a" acquired by "delete_volume" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:04 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c158137-e7f2-4423-8862-8317772128ba]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-de06165a-3894-413f-8f7b-eb46531d4cff tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-492aa3ae-591f-4ed1-9989-52f27174242a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:04 devstack sudo[87444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-492aa3ae-591f-4ed1-9989-52f27174242a Apr 21 20:56:04 devstack sudo[87444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:04 devstack sudo[87442]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3" returned: 0 in 0.591s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:04 devstack cinder-volume[81957]: DEBUG cinder.utils [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Path /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0f67a255-f3f8-456e-9eae-cfc20a008516 not found in is_blk_device check {{(pid=81957) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:56:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0f67a255-f3f8-456e-9eae-cfc20a008516 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:04 devstack sudo[87449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0f67a255-f3f8-456e-9eae-cfc20a008516 Apr 21 20:56:04 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:04 devstack sudo[87444]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-de06165a-3894-413f-8f7b-eb46531d4cff tempest-VolumesGetTest-967003488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-492aa3ae-591f-4ed1-9989-52f27174242a" returned: 0 in 0.530s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-de06165a-3894-413f-8f7b-eb46531d4cff tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-492aa3ae-591f-4ed1-9989-52f27174242a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:04 devstack sudo[87455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-492aa3ae-591f-4ed1-9989-52f27174242a Apr 21 20:56:04 devstack sudo[87455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:05 devstack sudo[87455]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-de06165a-3894-413f-8f7b-eb46531d4cff tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-492aa3ae-591f-4ed1-9989-52f27174242a" returned: 0 in 1.313s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:05 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-de06165a-3894-413f-8f7b-eb46531d4cff tempest-VolumesGetTest-967003488 None] Lock "cinder-quobyte-492aa3ae-591f-4ed1-9989-52f27174242a" released by "delete_volume" :: held 1.919s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:06 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-de06165a-3894-413f-8f7b-eb46531d4cff tempest-VolumesGetTest-967003488 None] Created reservations ['92982e55-5bf7-43e6-8dd2-5af4582bb9bc', '546ef734-41f1-4837-979d-bd14cb1fc22e', '215276b8-5a6f-42c8-8133-6638be054bc0', 'bf81ad64-c719-4908-9ac7-c65f7c115c22'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-de06165a-3894-413f-8f7b-eb46531d4cff tempest-VolumesGetTest-967003488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-de06165a-3894-413f-8f7b-eb46531d4cff tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-de06165a-3894-413f-8f7b-eb46531d4cff tempest-VolumesGetTest-967003488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-de06165a-3894-413f-8f7b-eb46531d4cff tempest-VolumesGetTest-967003488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-de06165a-3894-413f-8f7b-eb46531d4cff tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-de06165a-3894-413f-8f7b-eb46531d4cff tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:06 devstack sudo[87505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:56:06 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:06 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-11e84816-669a-4ed7-9ac8-1b010888086d tempest-VolumesGetTest-967003488 None] Acquiring lock "cinder-b75870e9-85ff-4685-a668-52c2d227444d-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:06 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-11e84816-669a-4ed7-9ac8-1b010888086d tempest-VolumesGetTest-967003488 None] Lock "cinder-b75870e9-85ff-4685-a668-52c2d227444d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:06 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-11e84816-669a-4ed7-9ac8-1b010888086d tempest-VolumesGetTest-967003488 None] Acquiring lock "cinder-quobyte-b75870e9-85ff-4685-a668-52c2d227444d" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:06 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-11e84816-669a-4ed7-9ac8-1b010888086d tempest-VolumesGetTest-967003488 None] Lock "cinder-quobyte-b75870e9-85ff-4685-a668-52c2d227444d" acquired by "delete_volume" :: waited 0.056s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:06 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[334430da-9b41-407f-9587-1f8404cc5dde]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-11e84816-669a-4ed7-9ac8-1b010888086d tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b75870e9-85ff-4685-a668-52c2d227444d {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:07 devstack sudo[87538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b75870e9-85ff-4685-a668-52c2d227444d Apr 21 20:56:07 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:07 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0f67a255-f3f8-456e-9eae-cfc20a008516" returned: 0 in 3.543s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:07 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8cc9ac-591e-4cdd-bc49-bf40de9d0d68]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:08 devstack sudo[87540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3 Apr 21 20:56:08 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:08 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-de06165a-3894-413f-8f7b-eb46531d4cff tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 2.031s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:08 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-de06165a-3894-413f-8f7b-eb46531d4cff tempest-VolumesGetTest-967003488 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:08 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-de06165a-3894-413f-8f7b-eb46531d4cff tempest-VolumesGetTest-967003488 None] Deleted volume successfully. Apr 21 20:56:08 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-de06165a-3894-413f-8f7b-eb46531d4cff tempest-VolumesGetTest-967003488 None] Lock "cinder-492aa3ae-591f-4ed1-9989-52f27174242a-delete_volume" released by "delete_volume" :: held 4.387s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:08 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-11e84816-669a-4ed7-9ac8-1b010888086d tempest-VolumesGetTest-967003488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b75870e9-85ff-4685-a668-52c2d227444d" returned: 0 in 1.496s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-11e84816-669a-4ed7-9ac8-1b010888086d tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b75870e9-85ff-4685-a668-52c2d227444d {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:08 devstack sudo[87547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b75870e9-85ff-4685-a668-52c2d227444d Apr 21 20:56:08 devstack sudo[87547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:08 devstack sudo[87547]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-11e84816-669a-4ed7-9ac8-1b010888086d tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b75870e9-85ff-4685-a668-52c2d227444d" returned: 0 in 0.449s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:08 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-11e84816-669a-4ed7-9ac8-1b010888086d tempest-VolumesGetTest-967003488 None] Lock "cinder-quobyte-b75870e9-85ff-4685-a668-52c2d227444d" released by "delete_volume" :: held 2.033s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:08 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-11e84816-669a-4ed7-9ac8-1b010888086d tempest-VolumesGetTest-967003488 None] Created reservations ['530433ee-83d1-405b-937a-fab8de4c37fa', '967894da-77f3-4c31-84d6-af39ede9ea7b', 'b0799860-3dd8-4336-aaec-fc00552c7804', '784f5045-2e88-4f6a-be13-7e1ad32bb867'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-11e84816-669a-4ed7-9ac8-1b010888086d tempest-VolumesGetTest-967003488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-11e84816-669a-4ed7-9ac8-1b010888086d tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:08 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-11e84816-669a-4ed7-9ac8-1b010888086d tempest-VolumesGetTest-967003488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:08 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-11e84816-669a-4ed7-9ac8-1b010888086d tempest-VolumesGetTest-967003488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-11e84816-669a-4ed7-9ac8-1b010888086d tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-11e84816-669a-4ed7-9ac8-1b010888086d tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:09 devstack sudo[87553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:56:09 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:09 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3" returned: 0 in 1.581s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:09 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3, size 1024.00 MB, duration 3.54 sec, destination /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0f67a255-f3f8-456e-9eae-cfc20a008516 {{(pid=81957) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:56:09 devstack cinder-volume[81957]: INFO cinder.image.image_utils [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Converted 1024.00 MB image at 288.92 MB/s Apr 21 20:56:09 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0f67a255-f3f8-456e-9eae-cfc20a008516 is being set with open permissions: ugo+rw Apr 21 20:56:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0f67a255-f3f8-456e-9eae-cfc20a008516 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:09 devstack sudo[87558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0f67a255-f3f8-456e-9eae-cfc20a008516 Apr 21 20:56:09 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:09 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Flow 'volume_create_manager' (cf148237-cee8-4083-9304-9575dcd9b159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2fdd0f-82c8-4aee-b662-d59952078295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2fdd0f-82c8-4aee-b662-d59952078295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1425073688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78eef98-765b-42c6-9c9f-ddcd1abc5d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4289da88b9a0409dac1de908352bbc57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:10Z,use_quota=True,user_id='aa2fd890ddbd4389b9da649ed74e5892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aabc935b-447b-4436-a708-cd31d1f5010c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aabc935b-447b-4436-a708-cd31d1f5010c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2319db10-dd97-4c0e-87d6-06f3c8ec3256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2319db10-dd97-4c0e-87d6-06f3c8ec3256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd78eef98-765b-42c6-9c9f-ddcd1abc5d31', 'volume_name': 'volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f1395d9-e799-4053-b269-64a88c32df51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f1395d9-e799-4053-b269-64a88c32df51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (444d3c21-7fb1-4cb5-9f72-24496a647cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:09 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Volume d78eef98-765b-42c6-9c9f-ddcd1abc5d31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31', 'volume_size': 1} Apr 21 20:56:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:09 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-11e84816-669a-4ed7-9ac8-1b010888086d tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.986s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:09 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-11e84816-669a-4ed7-9ac8-1b010888086d tempest-VolumesGetTest-967003488 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:09 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-11e84816-669a-4ed7-9ac8-1b010888086d tempest-VolumesGetTest-967003488 None] Deleted volume successfully. Apr 21 20:56:09 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-11e84816-669a-4ed7-9ac8-1b010888086d tempest-VolumesGetTest-967003488 None] Lock "cinder-b75870e9-85ff-4685-a668-52c2d227444d-delete_volume" released by "delete_volume" :: held 3.366s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:10 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0f67a255-f3f8-456e-9eae-cfc20a008516" returned: 0 in 0.668s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-0f67a255-f3f8-456e-9eae-cfc20a008516" released by "_copy_volume_from_snapshot" :: held 6.986s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-9503a089-9f42-4d68-a8a9-145d18b81213-0f67a255-f3f8-456e-9eae-cfc20a008516" released by "_create_volume_from_snapshot" :: held 7.010s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.033s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.395s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1425073688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78eef98-765b-42c6-9c9f-ddcd1abc5d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4289da88b9a0409dac1de908352bbc57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:10Z,use_quota=True,user_id='aa2fd890ddbd4389b9da649ed74e5892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Creating volume d78eef98-765b-42c6-9c9f-ddcd1abc5d31 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:10 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:10 devstack sudo[87563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 1073741824 Apr 21 20:56:10 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e72eb5d-cb15-4913-ae01-9e3ae9656865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f67a255-f3f8-456e-9eae-cfc20a008516', 'volume_size': 1, 'snapshot_id': '9503a089-9f42-4d68-a8a9-145d18b81213'}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1ca8cc-15dc-4a37-9c87-792aeaa98c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:10 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Volume volume-0f67a255-f3f8-456e-9eae-cfc20a008516 (0f67a255-f3f8-456e-9eae-cfc20a008516): created successfully Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1ca8cc-15dc-4a37-9c87-792aeaa98c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Flow 'volume_create_manager' (1c16a2df-4a17-444b-8390-1db8fa66effe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:10 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-9456b8ce-8977-48a1-aeeb-18c237ae97c4 tempest-VolumesSnapshotTestJSON-1313411673 None] Created volume successfully. Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Flow 'volume_create_manager' (eea9ac86-6947-40e4-896d-b3014a218ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7003ee34-d188-49c3-8efb-14bc2d0accaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7003ee34-d188-49c3-8efb-14bc2d0accaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-215266355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f429d7-0d1b-4c3e-9cce-4fea9520b0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='039e71df11954f30b9f04ccefb0ee1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:10Z,use_quota=True,user_id='a3a875821626480185a515a92503df5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b8b9ed4-d73e-48c4-b82f-9f582d323b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b8b9ed4-d73e-48c4-b82f-9f582d323b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a716221-d41c-46e3-a3c1-493d93abd733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a716221-d41c-46e3-a3c1-493d93abd733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73f429d7-0d1b-4c3e-9cce-4fea9520b0b5', 'volume_name': 'volume-73f429d7-0d1b-4c3e-9cce-4fea9520b0b5', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c025130a-7c29-4960-81ad-f0b8c59e695f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c025130a-7c29-4960-81ad-f0b8c59e695f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd60793-7b6f-44f1-8da7-2179ad631230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:10 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Volume 73f429d7-0d1b-4c3e-9cce-4fea9520b0b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73f429d7-0d1b-4c3e-9cce-4fea9520b0b5', 'volume_size': 1} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-4dc6360d-7076-4c2d-a537-0b2686a82898 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "cinder-0f67a255-f3f8-456e-9eae-cfc20a008516-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-4dc6360d-7076-4c2d-a537-0b2686a82898 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-0f67a255-f3f8-456e-9eae-cfc20a008516-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-4dc6360d-7076-4c2d-a537-0b2686a82898 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "cinder-quobyte-0f67a255-f3f8-456e-9eae-cfc20a008516" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-4dc6360d-7076-4c2d-a537-0b2686a82898 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-0f67a255-f3f8-456e-9eae-cfc20a008516" acquired by "delete_volume" :: waited 0.036s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[8663b381-a55a-44d0-928f-adf02c3b7189]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4dc6360d-7076-4c2d-a537-0b2686a82898 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0f67a255-f3f8-456e-9eae-cfc20a008516 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:11 devstack sudo[87568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0f67a255-f3f8-456e-9eae-cfc20a008516 Apr 21 20:56:11 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:11 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 1073741824" returned: 0 in 1.267s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:11 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 Apr 21 20:56:11 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:11 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4dc6360d-7076-4c2d-a537-0b2686a82898 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0f67a255-f3f8-456e-9eae-cfc20a008516" returned: 0 in 0.832s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4dc6360d-7076-4c2d-a537-0b2686a82898 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0f67a255-f3f8-456e-9eae-cfc20a008516 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:11 devstack sudo[87575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0f67a255-f3f8-456e-9eae-cfc20a008516 Apr 21 20:56:11 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:12 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31" returned: 0 in 0.560s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.451s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-215266355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f429d7-0d1b-4c3e-9cce-4fea9520b0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='039e71df11954f30b9f04ccefb0ee1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:10Z,use_quota=True,user_id='a3a875821626480185a515a92503df5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Creating volume 73f429d7-0d1b-4c3e-9cce-4fea9520b0b5 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:12 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-73f429d7-0d1b-4c3e-9cce-4fea9520b0b5 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (444d3c21-7fb1-4cb5-9f72-24496a647cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e0f116d-fcbf-4263-83c6-b991575b996f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:12 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Volume volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 (d78eef98-765b-42c6-9c9f-ddcd1abc5d31): created successfully Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e0f116d-fcbf-4263-83c6-b991575b996f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Flow 'volume_create_manager' (cf148237-cee8-4083-9304-9575dcd9b159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:12 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-9e577be4-1b9f-4709-b16b-66bb6dff0b49 tempest-VolumesGetTest-967003488 None] Created volume successfully. Apr 21 20:56:12 devstack sudo[87578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-73f429d7-0d1b-4c3e-9cce-4fea9520b0b5 1073741824 Apr 21 20:56:12 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-643fa249-9f2b-4006-9089-dcaf82f72637 tempest-VolumesActionsTest-541426287 None] Acquiring lock "cinder-a0e53625-e51c-4981-b33b-aaf9b4587db7" by "attach_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-643fa249-9f2b-4006-9089-dcaf82f72637 tempest-VolumesActionsTest-541426287 None] Lock "cinder-a0e53625-e51c-4981-b33b-aaf9b4587db7" acquired by "attach_volume" :: waited 0.030s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:12 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4dc6360d-7076-4c2d-a537-0b2686a82898 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0f67a255-f3f8-456e-9eae-cfc20a008516" returned: 0 in 0.849s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:12 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-643fa249-9f2b-4006-9089-dcaf82f72637 tempest-VolumesActionsTest-541426287 None] Attaching volume a0e53625-e51c-4981-b33b-aaf9b4587db7 to instance 41167320-46b3-4c82-bd43-9843f3aa3454 at mountpoint /dev/vdb on host None. Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-4dc6360d-7076-4c2d-a537-0b2686a82898 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-0f67a255-f3f8-456e-9eae-cfc20a008516" released by "delete_volume" :: held 1.792s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:12 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-643fa249-9f2b-4006-9089-dcaf82f72637 tempest-VolumesActionsTest-541426287 None] Attach volume completed successfully. Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-643fa249-9f2b-4006-9089-dcaf82f72637 tempest-VolumesActionsTest-541426287 None] Lock "cinder-a0e53625-e51c-4981-b33b-aaf9b4587db7" released by "attach_volume" :: held 0.151s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-4dc6360d-7076-4c2d-a537-0b2686a82898 tempest-VolumesSnapshotTestJSON-1313411673 None] Created reservations ['3b3c0655-bdea-45dd-8fbb-82b241a013ec', 'ed42b5a0-f9f8-4956-be12-946b140ccd94', 'b63efc2c-6308-4520-bc8d-37714fd37b5b', '44cbc133-a660-4085-b827-1650896c5a80'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4dc6360d-7076-4c2d-a537-0b2686a82898 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4dc6360d-7076-4c2d-a537-0b2686a82898 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-4dc6360d-7076-4c2d-a537-0b2686a82898 tempest-VolumesSnapshotTestJSON-1313411673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-4dc6360d-7076-4c2d-a537-0b2686a82898 tempest-VolumesSnapshotTestJSON-1313411673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4dc6360d-7076-4c2d-a537-0b2686a82898 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4dc6360d-7076-4c2d-a537-0b2686a82898 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:12 devstack sudo[87585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:56:12 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:13 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-73f429d7-0d1b-4c3e-9cce-4fea9520b0b5 1073741824" returned: 0 in 1.157s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-73f429d7-0d1b-4c3e-9cce-4fea9520b0b5 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:13 devstack sudo[87587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-73f429d7-0d1b-4c3e-9cce-4fea9520b0b5 Apr 21 20:56:13 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-29e24dcc-2672-4182-9709-4f16eeff8d85 tempest-VolumesActionsTest-541426287 None] Acquiring lock "cinder-a0e53625-e51c-4981-b33b-aaf9b4587db7-detach_volume" by "detach_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-29e24dcc-2672-4182-9709-4f16eeff8d85 tempest-VolumesActionsTest-541426287 None] Lock "cinder-a0e53625-e51c-4981-b33b-aaf9b4587db7-detach_volume" acquired by "detach_volume" :: waited 0.050s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:13 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-29e24dcc-2672-4182-9709-4f16eeff8d85 tempest-VolumesActionsTest-541426287 None] Detaching volume a0e53625-e51c-4981-b33b-aaf9b4587db7 from instance 41167320-46b3-4c82-bd43-9843f3aa3454. Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-d0407e6c-aa7b-4fc2-bf59-287300375a0d tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "cinder-9503a089-9f42-4d68-a8a9-145d18b81213-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-d0407e6c-aa7b-4fc2-bf59-287300375a0d tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-9503a089-9f42-4d68-a8a9-145d18b81213-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-d0407e6c-aa7b-4fc2-bf59-287300375a0d tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "cinder-quobyte-ab9fb624-4421-40ba-b512-a668c19378d3" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-d0407e6c-aa7b-4fc2-bf59-287300375a0d tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-ab9fb624-4421-40ba-b512-a668c19378d3" acquired by "delete_snapshot" :: waited 0.068s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-d0407e6c-aa7b-4fc2-bf59-287300375a0d tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "cinder-quobyte-9503a089-9f42-4d68-a8a9-145d18b81213" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-d0407e6c-aa7b-4fc2-bf59-287300375a0d tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-9503a089-9f42-4d68-a8a9-145d18b81213" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-d0407e6c-aa7b-4fc2-bf59-287300375a0d tempest-VolumesSnapshotTestJSON-1313411673 None] Deleting offline snapshot 9503a089-9f42-4d68-a8a9-145d18b81213 of volume ab9fb624-4421-40ba-b512-a668c19378d3 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:56:13 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-d0407e6c-aa7b-4fc2-bf59-287300375a0d tempest-VolumesSnapshotTestJSON-1313411673 None] snapshot_file for this snap is: volume-ab9fb624-4421-40ba-b512-a668c19378d3.9503a089-9f42-4d68-a8a9-145d18b81213 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4dc6360d-7076-4c2d-a537-0b2686a82898 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 1.023s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-4dc6360d-7076-4c2d-a537-0b2686a82898 tempest-VolumesSnapshotTestJSON-1313411673 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abbc7aa-4011-408f-866d-69f677d0d3e0]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:13 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-29e24dcc-2672-4182-9709-4f16eeff8d85 tempest-VolumesActionsTest-541426287 None] Detach volume completed successfully. Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d0407e6c-aa7b-4fc2-bf59-287300375a0d tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.9503a089-9f42-4d68-a8a9-145d18b81213 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:13 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-4dc6360d-7076-4c2d-a537-0b2686a82898 tempest-VolumesSnapshotTestJSON-1313411673 None] Deleted volume successfully. Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-29e24dcc-2672-4182-9709-4f16eeff8d85 tempest-VolumesActionsTest-541426287 None] Lock "cinder-a0e53625-e51c-4981-b33b-aaf9b4587db7-detach_volume" released by "detach_volume" :: held 0.383s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Flow 'volume_create_manager' (d6a84578-990e-4c0b-9945-a4c7850abc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc4619d6-d16d-42e8-be19-b8da1bd67514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc4619d6-d16d-42e8-be19-b8da1bd67514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-899750938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff04218-018a-4dd5-ab95-a922946ccacb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4289da88b9a0409dac1de908352bbc57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d78eef98-765b-42c6-9c9f-ddcd1abc5d31,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:14Z,use_quota=True,user_id='aa2fd890ddbd4389b9da649ed74e5892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b710ef7-fdd8-4cff-a164-d37b38215c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b710ef7-fdd8-4cff-a164-d37b38215c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227f7134-8ec2-442d-bdcd-215218404a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-4dc6360d-7076-4c2d-a537-0b2686a82898 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-0f67a255-f3f8-456e-9eae-cfc20a008516-delete_volume" released by "delete_volume" :: held 3.233s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227f7134-8ec2-442d-bdcd-215218404a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9ff04218-018a-4dd5-ab95-a922946ccacb', 'volume_name': 'volume-9ff04218-018a-4dd5-ab95-a922946ccacb', 'volume_size': 1, 'source_volid': 'd78eef98-765b-42c6-9c9f-ddcd1abc5d31', 'source_volstatus': 'available'}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ce2ab3-51f1-4750-bc4f-5f3a795c3a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:14 devstack sudo[87590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.9503a089-9f42-4d68-a8a9-145d18b81213 Apr 21 20:56:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ce2ab3-51f1-4750-bc4f-5f3a795c3a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:14 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b1e7ef-15a5-4ad3-9b7e-a36426b968cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:14 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Volume 9ff04218-018a-4dd5-ab95-a922946ccacb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9ff04218-018a-4dd5-ab95-a922946ccacb', 'volume_size': 1, 'source_volid': 'd78eef98-765b-42c6-9c9f-ddcd1abc5d31', 'source_volstatus': 'available'} Apr 21 20:56:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:14 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-73f429d7-0d1b-4c3e-9cce-4fea9520b0b5" returned: 0 in 0.818s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:14 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.117s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:14 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Cloning volume d78eef98-765b-42c6-9c9f-ddcd1abc5d31 to volume 9ff04218-018a-4dd5-ab95-a922946ccacb Apr 21 20:56:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd60793-7b6f-44f1-8da7-2179ad631230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73f429d7-0d1b-4c3e-9cce-4fea9520b0b5', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e48f75e-f0f1-46ed-8f9e-dda82ca0a8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:14 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Creating offline snapshot 84bebd61-28cc-4923-97d7-6bef63ae846f of volume d78eef98-765b-42c6-9c9f-ddcd1abc5d31 {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:56:14 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Volume volume-73f429d7-0d1b-4c3e-9cce-4fea9520b0b5 (73f429d7-0d1b-4c3e-9cce-4fea9520b0b5): created successfully Apr 21 20:56:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e48f75e-f0f1-46ed-8f9e-dda82ca0a8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Flow 'volume_create_manager' (eea9ac86-6947-40e4-896d-b3014a218ba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:14 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[061d7275-b5c3-4388-923e-f690829bbf85]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:14 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-9f227426-c43f-43c3-ac63-ce8fbfe5b4d1 tempest-ServerRescueNegativeTestJSON-555031924 None] Created volume successfully. Apr 21 20:56:14 devstack sudo[87593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 Apr 21 20:56:14 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:14 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d0407e6c-aa7b-4fc2-bf59-287300375a0d tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.9503a089-9f42-4d68-a8a9-145d18b81213" returned: 0 in 1.014s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:14 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-d0407e6c-aa7b-4fc2-bf59-287300375a0d tempest-VolumesSnapshotTestJSON-1313411673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab9fb624-4421-40ba-b512-a668c19378d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:56:14 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce43a962-0ca2-4e52-aabf-1a90e4ddac11]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d0407e6c-aa7b-4fc2-bf59-287300375a0d tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:15 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31" returned: 0 in 0.856s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.84bebd61-28cc-4923-97d7-6bef63ae846f 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:15 devstack sudo[87602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3 Apr 21 20:56:15 devstack sudo[87602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:15 devstack sudo[87603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.84bebd61-28cc-4923-97d7-6bef63ae846f 1G Apr 21 20:56:15 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:15 devstack sudo[87602]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d0407e6c-aa7b-4fc2-bf59-287300375a0d tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3" returned: 0 in 0.926s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d0407e6c-aa7b-4fc2-bf59-287300375a0d tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.9503a089-9f42-4d68-a8a9-145d18b81213 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:15 devstack sudo[87638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.9503a089-9f42-4d68-a8a9-145d18b81213 Apr 21 20:56:15 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:16 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.84bebd61-28cc-4923-97d7-6bef63ae846f 1G" returned: 0 in 1.291s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.84bebd61-28cc-4923-97d7-6bef63ae846f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:16 devstack sudo[87643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.84bebd61-28cc-4923-97d7-6bef63ae846f Apr 21 20:56:16 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:16 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d0407e6c-aa7b-4fc2-bf59-287300375a0d tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.9503a089-9f42-4d68-a8a9-145d18b81213" returned: 0 in 1.091s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d0407e6c-aa7b-4fc2-bf59-287300375a0d tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.9503a089-9f42-4d68-a8a9-145d18b81213 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:17 devstack sudo[87652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.9503a089-9f42-4d68-a8a9-145d18b81213 Apr 21 20:56:17 devstack sudo[87652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:17 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.84bebd61-28cc-4923-97d7-6bef63ae846f" returned: 0 in 0.797s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:17 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.84bebd61-28cc-4923-97d7-6bef63ae846f is being set with open permissions: ugo+rw Apr 21 20:56:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.84bebd61-28cc-4923-97d7-6bef63ae846f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:17 devstack sudo[87654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.84bebd61-28cc-4923-97d7-6bef63ae846f Apr 21 20:56:17 devstack sudo[87654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:17 devstack sudo[87652]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d0407e6c-aa7b-4fc2-bf59-287300375a0d tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3.9503a089-9f42-4d68-a8a9-145d18b81213" returned: 0 in 0.731s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:17 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-d0407e6c-aa7b-4fc2-bf59-287300375a0d tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-9503a089-9f42-4d68-a8a9-145d18b81213" released by "_delete_snapshot" :: held 4.003s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:17 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-d0407e6c-aa7b-4fc2-bf59-287300375a0d tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-ab9fb624-4421-40ba-b512-a668c19378d3" released by "delete_snapshot" :: held 4.044s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:17 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-d0407e6c-aa7b-4fc2-bf59-287300375a0d tempest-VolumesSnapshotTestJSON-1313411673 None] Created reservations ['4d15e246-df79-48b7-b346-c4639be2111f', '35884170-278d-404e-811c-24c016bc6ef7', '6a9316e8-d7aa-4785-9171-a4d0ac1a31d9', 'e7b6d791-1c59-4101-84b4-058c857d8b07'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:17 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-d0407e6c-aa7b-4fc2-bf59-287300375a0d tempest-VolumesSnapshotTestJSON-1313411673 None] Delete snapshot completed successfully. Apr 21 20:56:17 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-d0407e6c-aa7b-4fc2-bf59-287300375a0d tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-9503a089-9f42-4d68-a8a9-145d18b81213-delete_snapshot" released by "delete_snapshot" :: held 4.266s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:18 devstack sudo[87654]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.84bebd61-28cc-4923-97d7-6bef63ae846f" returned: 0 in 0.849s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:18 devstack sudo[87683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.info Apr 21 20:56:18 devstack sudo[87683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:18 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1c21c9b4-4c74-43f1-bd5b-69c3c7d69082 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "cinder-ab9fb624-4421-40ba-b512-a668c19378d3-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:18 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1c21c9b4-4c74-43f1-bd5b-69c3c7d69082 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-ab9fb624-4421-40ba-b512-a668c19378d3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:18 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1c21c9b4-4c74-43f1-bd5b-69c3c7d69082 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "cinder-quobyte-ab9fb624-4421-40ba-b512-a668c19378d3" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:18 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1c21c9b4-4c74-43f1-bd5b-69c3c7d69082 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-ab9fb624-4421-40ba-b512-a668c19378d3" acquired by "delete_volume" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:18 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c284e6e-bc49-44cf-8139-bec7d6cfff35]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1c21c9b4-4c74-43f1-bd5b-69c3c7d69082 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:18 devstack sudo[87685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3 Apr 21 20:56:18 devstack sudo[87685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:18 devstack sudo[87683]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.info" returned: 0 in 0.613s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:18 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.info is being set with open permissions: ugo+rw Apr 21 20:56:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:18 devstack sudo[87689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.info Apr 21 20:56:18 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:18 devstack sudo[87685]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1c21c9b4-4c74-43f1-bd5b-69c3c7d69082 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3" returned: 0 in 0.604s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1c21c9b4-4c74-43f1-bd5b-69c3c7d69082 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:18 devstack sudo[87695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3 Apr 21 20:56:18 devstack sudo[87695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:19 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.info" returned: 0 in 0.456s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Acquiring lock "cinder-quobyte-9ff04218-018a-4dd5-ab95-a922946ccacb" by "_copy_volume_from_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Lock "cinder-quobyte-9ff04218-018a-4dd5-ab95-a922946ccacb" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] snapshot: 84bebd61-28cc-4923-97d7-6bef63ae846f, volume: 9ff04218-018a-4dd5-ab95-a922946ccacb, {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[89144592-99fe-46b9-a28d-8fd8868695d0]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.84bebd61-28cc-4923-97d7-6bef63ae846f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:19 devstack sudo[87699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.84bebd61-28cc-4923-97d7-6bef63ae846f Apr 21 20:56:19 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:19 devstack sudo[87695]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1c21c9b4-4c74-43f1-bd5b-69c3c7d69082 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab9fb624-4421-40ba-b512-a668c19378d3" returned: 0 in 0.469s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1c21c9b4-4c74-43f1-bd5b-69c3c7d69082 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-ab9fb624-4421-40ba-b512-a668c19378d3" released by "delete_volume" :: held 1.111s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-1c21c9b4-4c74-43f1-bd5b-69c3c7d69082 tempest-VolumesSnapshotTestJSON-1313411673 None] Created reservations ['b3e69d6c-0c24-4e01-9643-1a1aee26a633', '0a52b766-82d4-4c25-bdd2-4f90a7d37b41', 'e56923df-37e8-47fb-b303-ccd76864c39c', '08e6d3a8-b562-4dea-8d9b-ea53bf1c2b7c'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1c21c9b4-4c74-43f1-bd5b-69c3c7d69082 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1c21c9b4-4c74-43f1-bd5b-69c3c7d69082 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-1c21c9b4-4c74-43f1-bd5b-69c3c7d69082 tempest-VolumesSnapshotTestJSON-1313411673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-1c21c9b4-4c74-43f1-bd5b-69c3c7d69082 tempest-VolumesSnapshotTestJSON-1313411673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1c21c9b4-4c74-43f1-bd5b-69c3c7d69082 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1c21c9b4-4c74-43f1-bd5b-69c3c7d69082 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:19 devstack sudo[87707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:56:19 devstack sudo[87707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:19 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.84bebd61-28cc-4923-97d7-6bef63ae846f" returned: 0 in 0.580s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Creating direct copy from snapshot {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afdfcd4-29fc-4d4c-906f-e45a0c4abb1c]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:19 devstack sudo[87713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 Apr 21 20:56:19 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:19 devstack sudo[87707]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1c21c9b4-4c74-43f1-bd5b-69c3c7d69082 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.487s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-1c21c9b4-4c74-43f1-bd5b-69c3c7d69082 tempest-VolumesSnapshotTestJSON-1313411673 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:19 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-1c21c9b4-4c74-43f1-bd5b-69c3c7d69082 tempest-VolumesSnapshotTestJSON-1313411673 None] Deleted volume successfully. Apr 21 20:56:19 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1c21c9b4-4c74-43f1-bd5b-69c3c7d69082 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-ab9fb624-4421-40ba-b512-a668c19378d3-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:20 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31" returned: 0 in 0.545s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:20 devstack cinder-volume[81957]: DEBUG cinder.utils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Path /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ff04218-018a-4dd5-ab95-a922946ccacb not found in is_blk_device check {{(pid=81957) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:56:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ff04218-018a-4dd5-ab95-a922946ccacb {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:20 devstack sudo[87718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ff04218-018a-4dd5-ab95-a922946ccacb Apr 21 20:56:20 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:20 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0296130b-afa5-4030-a1e1-415e038bb135 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "cinder-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:20 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0296130b-afa5-4030-a1e1-415e038bb135 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:20 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0296130b-afa5-4030-a1e1-415e038bb135 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "cinder-quobyte-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:20 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0296130b-afa5-4030-a1e1-415e038bb135 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:20 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c7f93f-6006-47f3-9fa5-9dcc08bc160e]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0296130b-afa5-4030-a1e1-415e038bb135 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:20 devstack sudo[87720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b Apr 21 20:56:20 devstack sudo[87720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:21 devstack sudo[87720]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0296130b-afa5-4030-a1e1-415e038bb135 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b" returned: 0 in 0.637s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0296130b-afa5-4030-a1e1-415e038bb135 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:21 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b Apr 21 20:56:21 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:23 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ff04218-018a-4dd5-ab95-a922946ccacb" returned: 0 in 3.209s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:23 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94507c2-02c8-4466-ac24-48d6cff44a55]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:23 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0296130b-afa5-4030-a1e1-415e038bb135 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b" returned: 0 in 2.374s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:23 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0296130b-afa5-4030-a1e1-415e038bb135 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-quobyte-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b" released by "delete_volume" :: held 3.068s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:23 devstack sudo[87769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 Apr 21 20:56:23 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:23 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-0296130b-afa5-4030-a1e1-415e038bb135 tempest-VolumesSnapshotTestJSON-1313411673 None] Created reservations ['8a3d8ae5-126d-4c27-ad02-10568637f395', '383b49b3-eb36-4dba-9a54-cc66196ad3d2', 'fd7354c3-1859-4a8b-9415-4cd6f14264b9', '51c05436-9073-4c8a-bd48-df36c7c6079d'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0296130b-afa5-4030-a1e1-415e038bb135 tempest-VolumesSnapshotTestJSON-1313411673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0296130b-afa5-4030-a1e1-415e038bb135 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:23 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0296130b-afa5-4030-a1e1-415e038bb135 tempest-VolumesSnapshotTestJSON-1313411673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:23 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0296130b-afa5-4030-a1e1-415e038bb135 tempest-VolumesSnapshotTestJSON-1313411673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0296130b-afa5-4030-a1e1-415e038bb135 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0296130b-afa5-4030-a1e1-415e038bb135 tempest-VolumesSnapshotTestJSON-1313411673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:23 devstack sudo[87771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:56:23 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d5c7a906-ab8c-4e3e-a0e3-25aae22f54d1 tempest-VolumesActionsTest-541426287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:24 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31" returned: 0 in 1.278s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:24 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31, size 1024.00 MB, duration 3.21 sec, destination /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ff04218-018a-4dd5-ab95-a922946ccacb {{(pid=81957) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:56:24 devstack cinder-volume[81957]: INFO cinder.image.image_utils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Converted 1024.00 MB image at 318.61 MB/s Apr 21 20:56:24 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ff04218-018a-4dd5-ab95-a922946ccacb is being set with open permissions: ugo+rw Apr 21 20:56:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ff04218-018a-4dd5-ab95-a922946ccacb {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:24 devstack sudo[87780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ff04218-018a-4dd5-ab95-a922946ccacb Apr 21 20:56:24 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:25 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0296130b-afa5-4030-a1e1-415e038bb135 tempest-VolumesSnapshotTestJSON-1313411673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 1.195s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:25 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-0296130b-afa5-4030-a1e1-415e038bb135 tempest-VolumesSnapshotTestJSON-1313411673 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:25 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-0296130b-afa5-4030-a1e1-415e038bb135 tempest-VolumesSnapshotTestJSON-1313411673 None] Deleted volume successfully. Apr 21 20:56:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-0296130b-afa5-4030-a1e1-415e038bb135 tempest-VolumesSnapshotTestJSON-1313411673 None] Lock "cinder-d2c2cc13-53ed-45d2-b5fc-bafeeb29303b-delete_volume" released by "delete_volume" :: held 4.591s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:25 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ff04218-018a-4dd5-ab95-a922946ccacb" returned: 0 in 0.580s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Lock "cinder-quobyte-9ff04218-018a-4dd5-ab95-a922946ccacb" released by "_copy_volume_from_snapshot" :: held 6.252s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Acquiring lock "cinder-quobyte-84bebd61-28cc-4923-97d7-6bef63ae846f" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Lock "cinder-quobyte-84bebd61-28cc-4923-97d7-6bef63ae846f" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:25 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Deleting offline snapshot 84bebd61-28cc-4923-97d7-6bef63ae846f of volume d78eef98-765b-42c6-9c9f-ddcd1abc5d31 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:56:25 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] snapshot_file for this snap is: volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.84bebd61-28cc-4923-97d7-6bef63ae846f {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:56:25 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[902760b8-a892-42c4-84d8-ec19787049b7]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.84bebd61-28cc-4923-97d7-6bef63ae846f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:25 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.84bebd61-28cc-4923-97d7-6bef63ae846f Apr 21 20:56:25 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:26 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.84bebd61-28cc-4923-97d7-6bef63ae846f" returned: 0 in 0.696s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:26 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:56:26 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96c212e-8385-4a50-b715-e675588f25fd]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:26 devstack sudo[87790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 Apr 21 20:56:26 devstack sudo[87790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:26 devstack sudo[87790]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31" returned: 0 in 0.572s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.84bebd61-28cc-4923-97d7-6bef63ae846f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:26 devstack sudo[87795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.84bebd61-28cc-4923-97d7-6bef63ae846f Apr 21 20:56:26 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:27 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.84bebd61-28cc-4923-97d7-6bef63ae846f" returned: 0 in 0.725s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.84bebd61-28cc-4923-97d7-6bef63ae846f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:27 devstack sudo[87825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.84bebd61-28cc-4923-97d7-6bef63ae846f Apr 21 20:56:27 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:28 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31.84bebd61-28cc-4923-97d7-6bef63ae846f" returned: 0 in 0.531s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:28 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Lock "cinder-quobyte-84bebd61-28cc-4923-97d7-6bef63ae846f" released by "_delete_snapshot" :: held 2.660s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.053s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d5c7a906-ab8c-4e3e-a0e3-25aae22f54d1 tempest-VolumesActionsTest-541426287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.716s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b1e7ef-15a5-4ad3-9b7e-a36426b968cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff04218-018a-4dd5-ab95-a922946ccacb', 'volume_size': 1, 'source_volid': 'd78eef98-765b-42c6-9c9f-ddcd1abc5d31', 'source_volstatus': 'available'}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60d34b8-55f9-4edc-8213-51071fa52d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:28 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b7effe-580e-44a6-aa3d-e3120811c522]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d5c7a906-ab8c-4e3e-a0e3-25aae22f54d1 tempest-VolumesActionsTest-541426287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:28 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Volume volume-9ff04218-018a-4dd5-ab95-a922946ccacb (9ff04218-018a-4dd5-ab95-a922946ccacb): created successfully Apr 21 20:56:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60d34b8-55f9-4edc-8213-51071fa52d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Flow 'volume_create_manager' (d6a84578-990e-4c0b-9945-a4c7850abc10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:28 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-6691103d-05dc-4a06-907c-0d1cccf68677 tempest-VolumesGetTest-967003488 None] Created volume successfully. Apr 21 20:56:28 devstack sudo[87852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 Apr 21 20:56:28 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:29 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d5c7a906-ab8c-4e3e-a0e3-25aae22f54d1 tempest-VolumesActionsTest-541426287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7" returned: 0 in 1.262s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:29 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9f53eb-925a-44f5-8bf4-8151d5382294]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d5c7a906-ab8c-4e3e-a0e3-25aae22f54d1 tempest-VolumesActionsTest-541426287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:29 devstack sudo[87862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 Apr 21 20:56:29 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Flow 'volume_create_manager' (453bc830-4001-443c-96f2-a9d7c7eaa51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99427340-b6fc-48b6-a277-db7349f24243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99427340-b6fc-48b6-a277-db7349f24243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1388457743',display_name='tempest-VolumesGetTest-Volume-1852728291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c678d77e-4a62-4437-8d70-e33f75e575a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4289da88b9a0409dac1de908352bbc57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:30Z,use_quota=True,user_id='aa2fd890ddbd4389b9da649ed74e5892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a16abd-20db-4151-bd90-4cff0e839da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a16abd-20db-4151-bd90-4cff0e839da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b122b7-9f92-489f-9b0f-210a46ee0e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b122b7-9f92-489f-9b0f-210a46ee0e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c678d77e-4a62-4437-8d70-e33f75e575a8', 'volume_name': 'volume-c678d77e-4a62-4437-8d70-e33f75e575a8', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744d8382-1db9-4647-ba62-56f7135d2fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744d8382-1db9-4647-ba62-56f7135d2fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e19b0f-8330-440b-a2fe-9a258876628f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:30 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Volume c678d77e-4a62-4437-8d70-e33f75e575a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c678d77e-4a62-4437-8d70-e33f75e575a8', 'volume_size': 1} Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-eb16042c-2b90-4c1f-9d74-b5e47599acc8 tempest-ServerRescueNegativeTestJSON-555031924 None] Acquiring lock "cinder-73f429d7-0d1b-4c3e-9cce-4fea9520b0b5-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-eb16042c-2b90-4c1f-9d74-b5e47599acc8 tempest-ServerRescueNegativeTestJSON-555031924 None] Lock "cinder-73f429d7-0d1b-4c3e-9cce-4fea9520b0b5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:30 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d5c7a906-ab8c-4e3e-a0e3-25aae22f54d1 tempest-VolumesActionsTest-541426287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7" returned: 0 in 0.933s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d5c7a906-ab8c-4e3e-a0e3-25aae22f54d1 tempest-VolumesActionsTest-541426287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 /opt/stack/data/cinder/conversion/a0e53625-e51c-4981-b33b-aaf9b4587db7.temp_image.4fbe5736-490b-4e50-86c2-18d281b7ba397ot6xait.img {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:30 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 /opt/stack/data/cinder/conversion/a0e53625-e51c-4981-b33b-aaf9b4587db7.temp_image.4fbe5736-490b-4e50-86c2-18d281b7ba397ot6xait.img Apr 21 20:56:30 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-eb16042c-2b90-4c1f-9d74-b5e47599acc8 tempest-ServerRescueNegativeTestJSON-555031924 None] Acquiring lock "cinder-quobyte-73f429d7-0d1b-4c3e-9cce-4fea9520b0b5" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-eb16042c-2b90-4c1f-9d74-b5e47599acc8 tempest-ServerRescueNegativeTestJSON-555031924 None] Lock "cinder-quobyte-73f429d7-0d1b-4c3e-9cce-4fea9520b0b5" acquired by "delete_volume" :: waited 0.014s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[896bc611-3fac-4fa0-a2c6-28dc1ebe3216]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-eb16042c-2b90-4c1f-9d74-b5e47599acc8 tempest-ServerRescueNegativeTestJSON-555031924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-73f429d7-0d1b-4c3e-9cce-4fea9520b0b5 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:30 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-73f429d7-0d1b-4c3e-9cce-4fea9520b0b5 Apr 21 20:56:30 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Flow 'volume_create_manager' (4e39442c-6776-4a60-a1ff-550b46c2775f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05bc15ee-5c48-4e2e-887e-7bd80d202864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05bc15ee-5c48-4e2e-887e-7bd80d202864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-691781706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e06b3e8-a0ed-4466-879b-bcbce97d7768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e970cfed63f4e72b8d3e7877e653176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:31Z,use_quota=True,user_id='b090e29e06de4904848051c6c31fdcc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6489a36a-9cf4-491e-bf77-0c7ccd8fb8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6489a36a-9cf4-491e-bf77-0c7ccd8fb8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3407d9dd-e1a9-4afc-8a3a-4fb079c63e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3407d9dd-e1a9-4afc-8a3a-4fb079c63e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e06b3e8-a0ed-4466-879b-bcbce97d7768', 'volume_name': 'volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab28c60-d932-458f-8fe7-6c340721723e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab28c60-d932-458f-8fe7-6c340721723e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741961ab-5681-4d16-b186-6087c5443b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:31 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Volume 7e06b3e8-a0ed-4466-879b-bcbce97d7768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768', 'volume_size': 1} Apr 21 20:56:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:31 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-eb16042c-2b90-4c1f-9d74-b5e47599acc8 tempest-ServerRescueNegativeTestJSON-555031924 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-73f429d7-0d1b-4c3e-9cce-4fea9520b0b5" returned: 0 in 1.255s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-eb16042c-2b90-4c1f-9d74-b5e47599acc8 tempest-ServerRescueNegativeTestJSON-555031924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-73f429d7-0d1b-4c3e-9cce-4fea9520b0b5 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:32 devstack sudo[87885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-73f429d7-0d1b-4c3e-9cce-4fea9520b0b5 Apr 21 20:56:32 devstack sudo[87885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:33 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d5c7a906-ab8c-4e3e-a0e3-25aae22f54d1 tempest-VolumesActionsTest-541426287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 /opt/stack/data/cinder/conversion/a0e53625-e51c-4981-b33b-aaf9b4587db7.temp_image.4fbe5736-490b-4e50-86c2-18d281b7ba397ot6xait.img" returned: 0 in 2.676s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:33 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c40c51-4193-461c-971c-d2fe7e566f0a]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d5c7a906-ab8c-4e3e-a0e3-25aae22f54d1 tempest-VolumesActionsTest-541426287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:33 devstack sudo[87887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 Apr 21 20:56:33 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:33 devstack sudo[87885]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-eb16042c-2b90-4c1f-9d74-b5e47599acc8 tempest-ServerRescueNegativeTestJSON-555031924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-73f429d7-0d1b-4c3e-9cce-4fea9520b0b5" returned: 0 in 1.435s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:33 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-eb16042c-2b90-4c1f-9d74-b5e47599acc8 tempest-ServerRescueNegativeTestJSON-555031924 None] Lock "cinder-quobyte-73f429d7-0d1b-4c3e-9cce-4fea9520b0b5" released by "delete_volume" :: held 2.741s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:33 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-eb16042c-2b90-4c1f-9d74-b5e47599acc8 tempest-ServerRescueNegativeTestJSON-555031924 None] Created reservations ['9796936f-6498-4768-adc4-c8fb6472edf9', '814436bc-3d44-4ee5-b0f7-8b18d8d7090e', '82ffc7c8-cb4d-46db-ad60-03d06f7cac17', 'bada378d-25a1-438a-a5bd-ed9c421621bf'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-eb16042c-2b90-4c1f-9d74-b5e47599acc8 tempest-ServerRescueNegativeTestJSON-555031924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-eb16042c-2b90-4c1f-9d74-b5e47599acc8 tempest-ServerRescueNegativeTestJSON-555031924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-eb16042c-2b90-4c1f-9d74-b5e47599acc8 tempest-ServerRescueNegativeTestJSON-555031924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-eb16042c-2b90-4c1f-9d74-b5e47599acc8 tempest-ServerRescueNegativeTestJSON-555031924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-eb16042c-2b90-4c1f-9d74-b5e47599acc8 tempest-ServerRescueNegativeTestJSON-555031924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-eb16042c-2b90-4c1f-9d74-b5e47599acc8 tempest-ServerRescueNegativeTestJSON-555031924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:33 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:56:33 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:33 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-eb16042c-2b90-4c1f-9d74-b5e47599acc8 tempest-ServerRescueNegativeTestJSON-555031924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.414s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:33 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-eb16042c-2b90-4c1f-9d74-b5e47599acc8 tempest-ServerRescueNegativeTestJSON-555031924 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:33 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-eb16042c-2b90-4c1f-9d74-b5e47599acc8 tempest-ServerRescueNegativeTestJSON-555031924 None] Deleted volume successfully. Apr 21 20:56:33 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-eb16042c-2b90-4c1f-9d74-b5e47599acc8 tempest-ServerRescueNegativeTestJSON-555031924 None] Lock "cinder-73f429d7-0d1b-4c3e-9cce-4fea9520b0b5-delete_volume" released by "delete_volume" :: held 3.309s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:33 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d5c7a906-ab8c-4e3e-a0e3-25aae22f54d1 tempest-VolumesActionsTest-541426287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7" returned: 0 in 0.627s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:33 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-d5c7a906-ab8c-4e3e-a0e3-25aae22f54d1 tempest-VolumesActionsTest-541426287 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7, size 1024.00 MB, duration 2.68 sec, destination /opt/stack/data/cinder/conversion/a0e53625-e51c-4981-b33b-aaf9b4587db7.temp_image.4fbe5736-490b-4e50-86c2-18d281b7ba397ot6xait.img {{(pid=81957) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:56:33 devstack cinder-volume[81957]: INFO cinder.image.image_utils [None req-d5c7a906-ab8c-4e3e-a0e3-25aae22f54d1 tempest-VolumesActionsTest-541426287 None] Converted 1024.00 MB image at 382.53 MB/s Apr 21 20:56:33 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-d5c7a906-ab8c-4e3e-a0e3-25aae22f54d1 tempest-VolumesActionsTest-541426287 None] 4fbe5736-490b-4e50-86c2-18d281b7ba39 was raw, no need to convert to raw {{(pid=81957) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 21 20:56:43 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:UPDATE=129,cinder:DELETE=4,cinder:SELECT=104,cinder:INSERT=31 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:56:43 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:SELECT=107,cinder:UPDATE=120,cinder:INSERT=31,cinder:DELETE=16 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:56:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d5c7a906-ab8c-4e3e-a0e3-25aae22f54d1 tempest-VolumesActionsTest-541426287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.859s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d5c7a906-ab8c-4e3e-a0e3-25aae22f54d1 tempest-VolumesActionsTest-541426287 None] Uploaded volume to glance image-id: 4fbe5736-490b-4e50-86c2-18d281b7ba39. {{(pid=81957) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 21 20:56:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.906s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:44 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1388457743',display_name='tempest-VolumesGetTest-Volume-1852728291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c678d77e-4a62-4437-8d70-e33f75e575a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4289da88b9a0409dac1de908352bbc57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:30Z,use_quota=True,user_id='aa2fd890ddbd4389b9da649ed74e5892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:44 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Creating volume c678d77e-4a62-4437-8d70-e33f75e575a8 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:44 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:44 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:44 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:44 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:56:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c678d77e-4a62-4437-8d70-e33f75e575a8 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:44 devstack sudo[87974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c678d77e-4a62-4437-8d70-e33f75e575a8 1073741824 Apr 21 20:56:44 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:44 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-d5c7a906-ab8c-4e3e-a0e3-25aae22f54d1 tempest-VolumesActionsTest-541426287 None] Copy volume to image completed successfully. Apr 21 20:56:44 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c678d77e-4a62-4437-8d70-e33f75e575a8 1073741824" returned: 0 in 0.514s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c678d77e-4a62-4437-8d70-e33f75e575a8 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:44 devstack sudo[87979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c678d77e-4a62-4437-8d70-e33f75e575a8 Apr 21 20:56:44 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:45 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c678d77e-4a62-4437-8d70-e33f75e575a8" returned: 0 in 0.415s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.010s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-691781706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e06b3e8-a0ed-4466-879b-bcbce97d7768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e970cfed63f4e72b8d3e7877e653176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:31Z,use_quota=True,user_id='b090e29e06de4904848051c6c31fdcc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Creating volume 7e06b3e8-a0ed-4466-879b-bcbce97d7768 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:45 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e19b0f-8330-440b-a2fe-9a258876628f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c678d77e-4a62-4437-8d70-e33f75e575a8', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:45 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 1073741824 Apr 21 20:56:45 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4296f6d2-aff9-4fcb-aa7f-083da2be8926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:45 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Volume volume-c678d77e-4a62-4437-8d70-e33f75e575a8 (c678d77e-4a62-4437-8d70-e33f75e575a8): created successfully Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4296f6d2-aff9-4fcb-aa7f-083da2be8926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Flow 'volume_create_manager' (453bc830-4001-443c-96f2-a9d7c7eaa51e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:45 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-473f9337-206e-4db9-bd53-46df5f6eb5b1 tempest-VolumesGetTest-967003488 None] Created volume successfully. Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ef31aa28-86b4-4338-9775-2bd381937c1f tempest-VolumesGetTest-967003488 None] Acquiring lock "cinder-c678d77e-4a62-4437-8d70-e33f75e575a8-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ef31aa28-86b4-4338-9775-2bd381937c1f tempest-VolumesGetTest-967003488 None] Lock "cinder-c678d77e-4a62-4437-8d70-e33f75e575a8-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ef31aa28-86b4-4338-9775-2bd381937c1f tempest-VolumesGetTest-967003488 None] Acquiring lock "cinder-quobyte-c678d77e-4a62-4437-8d70-e33f75e575a8" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ef31aa28-86b4-4338-9775-2bd381937c1f tempest-VolumesGetTest-967003488 None] Lock "cinder-quobyte-c678d77e-4a62-4437-8d70-e33f75e575a8" acquired by "delete_volume" :: waited 0.019s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76d4f04-a2b3-4ee2-a3f5-d4e85715a729]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ef31aa28-86b4-4338-9775-2bd381937c1f tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c678d77e-4a62-4437-8d70-e33f75e575a8 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:45 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c678d77e-4a62-4437-8d70-e33f75e575a8 Apr 21 20:56:45 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:45 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 1073741824" returned: 0 in 0.538s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:45 devstack sudo[87989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 Apr 21 20:56:45 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:45 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ef31aa28-86b4-4338-9775-2bd381937c1f tempest-VolumesGetTest-967003488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c678d77e-4a62-4437-8d70-e33f75e575a8" returned: 0 in 0.521s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ef31aa28-86b4-4338-9775-2bd381937c1f tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c678d77e-4a62-4437-8d70-e33f75e575a8 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:45 devstack sudo[87994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c678d77e-4a62-4437-8d70-e33f75e575a8 Apr 21 20:56:45 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:46 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768" returned: 0 in 0.439s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.289s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741961ab-5681-4d16-b186-6087c5443b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e57397-2a28-43ed-818d-757c85a78182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[926194ee-75b7-40e7-a184-38a9a7338c3d]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:46 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Volume volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 (7e06b3e8-a0ed-4466-879b-bcbce97d7768): created successfully Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e57397-2a28-43ed-818d-757c85a78182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Flow 'volume_create_manager' (4e39442c-6776-4a60-a1ff-550b46c2775f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:46 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-eb3bdab4-2015-4f2f-a46c-f8a005c4020b tempest-VolumeDependencyTests-582766483 None] Created volume successfully. Apr 21 20:56:46 devstack sudo[87998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 Apr 21 20:56:46 devstack sudo[87998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:46 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ef31aa28-86b4-4338-9775-2bd381937c1f tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c678d77e-4a62-4437-8d70-e33f75e575a8" returned: 0 in 0.435s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ef31aa28-86b4-4338-9775-2bd381937c1f tempest-VolumesGetTest-967003488 None] Lock "cinder-quobyte-c678d77e-4a62-4437-8d70-e33f75e575a8" released by "delete_volume" :: held 0.975s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-ef31aa28-86b4-4338-9775-2bd381937c1f tempest-VolumesGetTest-967003488 None] Created reservations ['53015f1f-33a9-4e5c-8283-9733c3077c95', 'd8dc3b18-fbb2-4a69-a2fa-3014994e5bb1', 'dfab102f-067c-4e2a-988e-dcbe9661874b', '77a592a7-c751-4675-b85d-651a5148f848'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ef31aa28-86b4-4338-9775-2bd381937c1f tempest-VolumesGetTest-967003488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ef31aa28-86b4-4338-9775-2bd381937c1f tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ef31aa28-86b4-4338-9775-2bd381937c1f tempest-VolumesGetTest-967003488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ef31aa28-86b4-4338-9775-2bd381937c1f tempest-VolumesGetTest-967003488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ef31aa28-86b4-4338-9775-2bd381937c1f tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ef31aa28-86b4-4338-9775-2bd381937c1f tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:46 devstack sudo[88001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:56:46 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-665070b0-24d2-458f-a0b7-e883d3dd8413 tempest-VolumesGetTest-967003488 None] Acquiring lock "cinder-9ff04218-018a-4dd5-ab95-a922946ccacb-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-665070b0-24d2-458f-a0b7-e883d3dd8413 tempest-VolumesGetTest-967003488 None] Lock "cinder-9ff04218-018a-4dd5-ab95-a922946ccacb-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-665070b0-24d2-458f-a0b7-e883d3dd8413 tempest-VolumesGetTest-967003488 None] Acquiring lock "cinder-quobyte-9ff04218-018a-4dd5-ab95-a922946ccacb" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-665070b0-24d2-458f-a0b7-e883d3dd8413 tempest-VolumesGetTest-967003488 None] Lock "cinder-quobyte-9ff04218-018a-4dd5-ab95-a922946ccacb" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[049ad8d1-d1ca-4dc5-acac-a20b7990d965]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-665070b0-24d2-458f-a0b7-e883d3dd8413 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ff04218-018a-4dd5-ab95-a922946ccacb {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:46 devstack sudo[88006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ff04218-018a-4dd5-ab95-a922946ccacb Apr 21 20:56:46 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:46 devstack sudo[87998]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7" returned: 0 in 0.568s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ceebc2-65a0-4747-8409-f3866002b9ab]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:46 devstack sudo[88008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 Apr 21 20:56:46 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:46 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ef31aa28-86b4-4338-9775-2bd381937c1f tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.444s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-ef31aa28-86b4-4338-9775-2bd381937c1f tempest-VolumesGetTest-967003488 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:46 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-ef31aa28-86b4-4338-9775-2bd381937c1f tempest-VolumesGetTest-967003488 None] Deleted volume successfully. Apr 21 20:56:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ef31aa28-86b4-4338-9775-2bd381937c1f tempest-VolumesGetTest-967003488 None] Lock "cinder-c678d77e-4a62-4437-8d70-e33f75e575a8-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9f066b2c-c83d-4b79-abf5-aacc7cc1a528 tempest-VolumeDependencyTests-582766483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:47 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-665070b0-24d2-458f-a0b7-e883d3dd8413 tempest-VolumesGetTest-967003488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ff04218-018a-4dd5-ab95-a922946ccacb" returned: 0 in 0.572s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-665070b0-24d2-458f-a0b7-e883d3dd8413 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ff04218-018a-4dd5-ab95-a922946ccacb {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:47 devstack sudo[88017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ff04218-018a-4dd5-ab95-a922946ccacb Apr 21 20:56:47 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:47 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7" returned: 0 in 0.545s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 /opt/stack/data/cinder/conversion/a0e53625-e51c-4981-b33b-aaf9b4587db7.temp_image.9aaff159-aa0e-4932-a386-f2faacdf4aeef67v9nv6.img {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:47 devstack sudo[88019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 /opt/stack/data/cinder/conversion/a0e53625-e51c-4981-b33b-aaf9b4587db7.temp_image.9aaff159-aa0e-4932-a386-f2faacdf4aeef67v9nv6.img Apr 21 20:56:47 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:47 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-665070b0-24d2-458f-a0b7-e883d3dd8413 tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ff04218-018a-4dd5-ab95-a922946ccacb" returned: 0 in 0.418s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-665070b0-24d2-458f-a0b7-e883d3dd8413 tempest-VolumesGetTest-967003488 None] Lock "cinder-quobyte-9ff04218-018a-4dd5-ab95-a922946ccacb" released by "delete_volume" :: held 1.013s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:47 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-665070b0-24d2-458f-a0b7-e883d3dd8413 tempest-VolumesGetTest-967003488 None] Created reservations ['9ee28695-6191-44a5-93c0-02fbb8cea9a0', 'fcc03512-e730-4e70-a35c-5b5ab86b9466', 'b9ae4f2a-8592-4e8e-95ad-14b2ce930931', '11c30143-c80f-4069-bed7-d67bcae53b3e'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-665070b0-24d2-458f-a0b7-e883d3dd8413 tempest-VolumesGetTest-967003488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-665070b0-24d2-458f-a0b7-e883d3dd8413 tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-665070b0-24d2-458f-a0b7-e883d3dd8413 tempest-VolumesGetTest-967003488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-665070b0-24d2-458f-a0b7-e883d3dd8413 tempest-VolumesGetTest-967003488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-665070b0-24d2-458f-a0b7-e883d3dd8413 tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-665070b0-24d2-458f-a0b7-e883d3dd8413 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:47 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:56:47 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:49 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-665070b0-24d2-458f-a0b7-e883d3dd8413 tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 1.501s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:49 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-665070b0-24d2-458f-a0b7-e883d3dd8413 tempest-VolumesGetTest-967003488 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:49 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-665070b0-24d2-458f-a0b7-e883d3dd8413 tempest-VolumesGetTest-967003488 None] Deleted volume successfully. Apr 21 20:56:49 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 /opt/stack/data/cinder/conversion/a0e53625-e51c-4981-b33b-aaf9b4587db7.temp_image.9aaff159-aa0e-4932-a386-f2faacdf4aeef67v9nv6.img" returned: 0 in 2.202s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:49 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[973b4d67-d258-4286-a7a6-e2588bd6da26]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:49 devstack sudo[88036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 Apr 21 20:56:49 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:49 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-665070b0-24d2-458f-a0b7-e883d3dd8413 tempest-VolumesGetTest-967003488 None] Lock "cinder-9ff04218-018a-4dd5-ab95-a922946ccacb-delete_volume" released by "delete_volume" :: held 3.094s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:49 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ff238bb3-fd6b-4672-80e8-e3aaa1e898bd tempest-VolumesGetTest-967003488 None] Acquiring lock "cinder-d78eef98-765b-42c6-9c9f-ddcd1abc5d31-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:49 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ff238bb3-fd6b-4672-80e8-e3aaa1e898bd tempest-VolumesGetTest-967003488 None] Lock "cinder-d78eef98-765b-42c6-9c9f-ddcd1abc5d31-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:49 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ff238bb3-fd6b-4672-80e8-e3aaa1e898bd tempest-VolumesGetTest-967003488 None] Acquiring lock "cinder-quobyte-d78eef98-765b-42c6-9c9f-ddcd1abc5d31" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:49 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ff238bb3-fd6b-4672-80e8-e3aaa1e898bd tempest-VolumesGetTest-967003488 None] Lock "cinder-quobyte-d78eef98-765b-42c6-9c9f-ddcd1abc5d31" acquired by "delete_volume" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:49 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[2475883f-6a16-42fa-8e0d-1efa0567d0c0]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ff238bb3-fd6b-4672-80e8-e3aaa1e898bd tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:49 devstack sudo[88038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 Apr 21 20:56:49 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:50 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7" returned: 0 in 0.712s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:50 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7, size 1024.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/conversion/a0e53625-e51c-4981-b33b-aaf9b4587db7.temp_image.9aaff159-aa0e-4932-a386-f2faacdf4aeef67v9nv6.img {{(pid=81957) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:56:50 devstack cinder-volume[81957]: INFO cinder.image.image_utils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] Converted 1024.00 MB image at 464.91 MB/s Apr 21 20:56:50 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] 9aaff159-aa0e-4932-a386-f2faacdf4aee was raw, converting to qcow2 {{(pid=81957) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 21 20:56:50 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[627a9737-f70a-4585-99b9-afcfbc43dea8]: (4, 'raw') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a0e53625-e51c-4981-b33b-aaf9b4587db7.temp_image.9aaff159-aa0e-4932-a386-f2faacdf4aeef67v9nv6.img {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:50 devstack sudo[88045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a0e53625-e51c-4981-b33b-aaf9b4587db7.temp_image.9aaff159-aa0e-4932-a386-f2faacdf4aeef67v9nv6.img Apr 21 20:56:50 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:50 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ff238bb3-fd6b-4672-80e8-e3aaa1e898bd tempest-VolumesGetTest-967003488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31" returned: 0 in 0.575s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ff238bb3-fd6b-4672-80e8-e3aaa1e898bd tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:50 devstack sudo[88049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31 Apr 21 20:56:50 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:50 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a0e53625-e51c-4981-b33b-aaf9b4587db7.temp_image.9aaff159-aa0e-4932-a386-f2faacdf4aeef67v9nv6.img" returned: 0 in 0.545s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0e53625-e51c-4981-b33b-aaf9b4587db7.temp_image.9aaff159-aa0e-4932-a386-f2faacdf4aeef67v9nv6.img {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:50 devstack sudo[88054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0e53625-e51c-4981-b33b-aaf9b4587db7.temp_image.9aaff159-aa0e-4932-a386-f2faacdf4aeef67v9nv6.img Apr 21 20:56:50 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:50 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ff238bb3-fd6b-4672-80e8-e3aaa1e898bd tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d78eef98-765b-42c6-9c9f-ddcd1abc5d31" returned: 0 in 0.489s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:50 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ff238bb3-fd6b-4672-80e8-e3aaa1e898bd tempest-VolumesGetTest-967003488 None] Lock "cinder-quobyte-d78eef98-765b-42c6-9c9f-ddcd1abc5d31" released by "delete_volume" :: held 1.099s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:50 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-ff238bb3-fd6b-4672-80e8-e3aaa1e898bd tempest-VolumesGetTest-967003488 None] Created reservations ['1658efae-cc76-4e81-b71b-2104226ff289', '61f39c6d-dd6e-4479-8c61-56153dcee5ef', 'a144437a-0aa2-4d2f-8fbe-dd82e1935c6b', '42017655-ee72-4d3c-950f-dd82ed398372'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ff238bb3-fd6b-4672-80e8-e3aaa1e898bd tempest-VolumesGetTest-967003488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ff238bb3-fd6b-4672-80e8-e3aaa1e898bd tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:50 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ff238bb3-fd6b-4672-80e8-e3aaa1e898bd tempest-VolumesGetTest-967003488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:50 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ff238bb3-fd6b-4672-80e8-e3aaa1e898bd tempest-VolumesGetTest-967003488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ff238bb3-fd6b-4672-80e8-e3aaa1e898bd tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ff238bb3-fd6b-4672-80e8-e3aaa1e898bd tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:50 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:56:50 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:51 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0e53625-e51c-4981-b33b-aaf9b4587db7.temp_image.9aaff159-aa0e-4932-a386-f2faacdf4aeef67v9nv6.img" returned: 1 in 0.531s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0e53625-e51c-4981-b33b-aaf9b4587db7.temp_image.9aaff159-aa0e-4932-a386-f2faacdf4aeef67v9nv6.img' failed. Not Retrying. {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:56:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a0e53625-e51c-4981-b33b-aaf9b4587db7.temp_image.9aaff159-aa0e-4932-a386-f2faacdf4aeef67v9nv6.img /opt/stack/data/cinder/conversion/vol_upload_w52tcta4 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:51 devstack sudo[88061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a0e53625-e51c-4981-b33b-aaf9b4587db7.temp_image.9aaff159-aa0e-4932-a386-f2faacdf4aeef67v9nv6.img /opt/stack/data/cinder/conversion/vol_upload_w52tcta4 Apr 21 20:56:51 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:51 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ff238bb3-fd6b-4672-80e8-e3aaa1e898bd tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.496s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:51 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-ff238bb3-fd6b-4672-80e8-e3aaa1e898bd tempest-VolumesGetTest-967003488 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:51 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-ff238bb3-fd6b-4672-80e8-e3aaa1e898bd tempest-VolumesGetTest-967003488 None] Deleted volume successfully. Apr 21 20:56:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ff238bb3-fd6b-4672-80e8-e3aaa1e898bd tempest-VolumesGetTest-967003488 None] Lock "cinder-d78eef98-765b-42c6-9c9f-ddcd1abc5d31-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:51 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a0e53625-e51c-4981-b33b-aaf9b4587db7.temp_image.9aaff159-aa0e-4932-a386-f2faacdf4aeef67v9nv6.img /opt/stack/data/cinder/conversion/vol_upload_w52tcta4" returned: 0 in 0.527s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:51 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] Image conversion details: src /opt/stack/data/cinder/conversion/a0e53625-e51c-4981-b33b-aaf9b4587db7.temp_image.9aaff159-aa0e-4932-a386-f2faacdf4aeef67v9nv6.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_w52tcta4 {{(pid=81957) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:56:51 devstack cinder-volume[81957]: INFO cinder.image.image_utils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 21 20:56:51 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb403c4b-4db1-47c2-986f-30ad57e5f881]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w52tcta4 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:51 devstack sudo[88067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w52tcta4 Apr 21 20:56:51 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:52 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Flow 'volume_create_manager' (897fdb2a-7043-49e9-b69b-a7b25a80da67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb0dddc-79ca-4839-bd20-3cbfae22de57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb0dddc-79ca-4839-bd20-3cbfae22de57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1248730931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ef0cc7-8d02-409c-83d3-d4ed015cf77e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4289da88b9a0409dac1de908352bbc57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:52Z,use_quota=True,user_id='aa2fd890ddbd4389b9da649ed74e5892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b763266a-0d81-4c11-b869-013f7005cec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b763266a-0d81-4c11-b869-013f7005cec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff26b8e-1b9d-4a3b-b806-19a0687c8583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:52 devstack cinder-volume[81957]: DEBUG cinder.image.glance [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Creating Keystone auth plugin from conf {{(pid=81957) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 21 20:56:52 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w52tcta4" returned: 0 in 0.645s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff26b8e-1b9d-4a3b-b806-19a0687c8583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f6ef0cc7-8d02-409c-83d3-d4ed015cf77e', 'volume_name': 'volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e', 'volume_size': 1, 'image_id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea9a1f20637b41ec8f283a778363aed0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c112cf7-9f7d-490e-8e52-abb08838bafa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24207be9-036c-44be-a8a3-630b385b974e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24207be9-036c-44be-a8a3-630b385b974e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:52 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e40a63c-4608-4b54-a404-5bf081aeac52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:52 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Volume f6ef0cc7-8d02-409c-83d3-d4ed015cf77e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e', 'volume_size': 1, 'image_id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea9a1f20637b41ec8f283a778363aed0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c112cf7-9f7d-490e-8e52-abb08838bafa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 21 20:56:52 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Trying to clone f6ef0cc7-8d02-409c-83d3-d4ed015cf77e from image 1c112cf7-9f7d-490e-8e52-abb08838bafa at location (None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}]). {{(pid=81957) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 21 20:56:52 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_1e3j7yi6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81957) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 21 20:56:52 devstack cinder-volume[81957]: INFO cinder.image.image_utils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Image download 20.69 MB at 20.69 MB/s Apr 21 20:56:52 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd582c0-763b-4d0c-ac1d-46c2e8e8ddce]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_1e3j7yi6devstack@QuobyteHD {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:52 devstack sudo[88074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_1e3j7yi6devstack@QuobyteHD Apr 21 20:56:52 devstack sudo[88074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.461s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:53 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] Uploaded volume to glance image-id: 9aaff159-aa0e-4932-a386-f2faacdf4aee. {{(pid=81957) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 21 20:56:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9f066b2c-c83d-4b79-abf5-aacc7cc1a528 tempest-VolumeDependencyTests-582766483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.429s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-9f066b2c-c83d-4b79-abf5-aacc7cc1a528 tempest-VolumeDependencyTests-582766483 None] Creating offline snapshot 58ed495c-f9f6-42cb-9c51-94cc602497cc of volume 7e06b3e8-a0ed-4466-879b-bcbce97d7768 {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:56:53 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-ddb0dc5a-d5f0-4866-a703-59d96ffe5762 tempest-VolumesActionsTest-541426287 None] Copy volume to image completed successfully. Apr 21 20:56:53 devstack sudo[88074]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_1e3j7yi6devstack@QuobyteHD" returned: 0 in 0.630s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:53 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Temporary image 1c112cf7-9f7d-490e-8e52-abb08838bafa is fetched for user aa2fd890ddbd4389b9da649ed74e5892. {{(pid=81957) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 21 20:56:53 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[59780b36-7ec7-4f4e-b9c5-a892699c5c4f]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9f066b2c-c83d-4b79-abf5-aacc7cc1a528 tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:53 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d44a06f-adcf-4a3d-8fbe-278aa5ecc0c8]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_1e3j7yi6devstack@QuobyteHD {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:53 devstack sudo[88079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 Apr 21 20:56:53 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:53 devstack sudo[88080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_1e3j7yi6devstack@QuobyteHD Apr 21 20:56:53 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:53 devstack cinder-volume[81957]: DEBUG oslo_service.periodic_task [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81957) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:56:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:53 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:56:53 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:54 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_1e3j7yi6devstack@QuobyteHD" returned: 0 in 0.595s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:54 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9f066b2c-c83d-4b79-abf5-aacc7cc1a528 tempest-VolumeDependencyTests-582766483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768" returned: 0 in 0.706s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9f066b2c-c83d-4b79-abf5-aacc7cc1a528 tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.58ed495c-f9f6-42cb-9c51-94cc602497cc 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:54 devstack sudo[88091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.58ed495c-f9f6-42cb-9c51-94cc602497cc 1G Apr 21 20:56:54 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:54 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-6620c681-73af-4c86-888c-d3935bf2b43c tempest-GroupSnapshotsTest-759127538 None] Group tempest-GroupSnapshotsTest-Group-1375086006: creating Apr 21 20:56:54 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-6620c681-73af-4c86-888c-d3935bf2b43c tempest-GroupSnapshotsTest-759127538 None] Group tempest-GroupSnapshotsTest-Group-1375086006: created successfully Apr 21 20:56:54 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-6620c681-73af-4c86-888c-d3935bf2b43c tempest-GroupSnapshotsTest-759127538 None] Create group completed successfully. Apr 21 20:56:54 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.566s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:54 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:54 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-192d2c35-3428-4640-a202-4a42953ed5bf tempest-VolumesActionsTest-541426287 None] Acquiring lock "cinder-a0e53625-e51c-4981-b33b-aaf9b4587db7-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:54 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-192d2c35-3428-4640-a202-4a42953ed5bf tempest-VolumesActionsTest-541426287 None] Lock "cinder-a0e53625-e51c-4981-b33b-aaf9b4587db7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:54 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-192d2c35-3428-4640-a202-4a42953ed5bf tempest-VolumesActionsTest-541426287 None] Acquiring lock "cinder-quobyte-a0e53625-e51c-4981-b33b-aaf9b4587db7" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:54 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-192d2c35-3428-4640-a202-4a42953ed5bf tempest-VolumesActionsTest-541426287 None] Lock "cinder-quobyte-a0e53625-e51c-4981-b33b-aaf9b4587db7" acquired by "delete_volume" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:54 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed723d24-3b08-4da6-b24b-b5dc94b48e45]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-192d2c35-3428-4640-a202-4a42953ed5bf tempest-VolumesActionsTest-541426287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:54 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 Apr 21 20:56:54 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:54 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9f066b2c-c83d-4b79-abf5-aacc7cc1a528 tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.58ed495c-f9f6-42cb-9c51-94cc602497cc 1G" returned: 0 in 0.586s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9f066b2c-c83d-4b79-abf5-aacc7cc1a528 tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.58ed495c-f9f6-42cb-9c51-94cc602497cc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:54 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.58ed495c-f9f6-42cb-9c51-94cc602497cc Apr 21 20:56:54 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:55 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-192d2c35-3428-4640-a202-4a42953ed5bf tempest-VolumesActionsTest-541426287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7" returned: 0 in 0.486s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-192d2c35-3428-4640-a202-4a42953ed5bf tempest-VolumesActionsTest-541426287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:55 devstack sudo[88106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7 Apr 21 20:56:55 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:55 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9f066b2c-c83d-4b79-abf5-aacc7cc1a528 tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.58ed495c-f9f6-42cb-9c51-94cc602497cc" returned: 0 in 0.471s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:55 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-9f066b2c-c83d-4b79-abf5-aacc7cc1a528 tempest-VolumeDependencyTests-582766483 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.58ed495c-f9f6-42cb-9c51-94cc602497cc is being set with open permissions: ugo+rw Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9f066b2c-c83d-4b79-abf5-aacc7cc1a528 tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.58ed495c-f9f6-42cb-9c51-94cc602497cc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:55 devstack sudo[88109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.58ed495c-f9f6-42cb-9c51-94cc602497cc Apr 21 20:56:55 devstack sudo[88109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:55 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-192d2c35-3428-4640-a202-4a42953ed5bf tempest-VolumesActionsTest-541426287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a0e53625-e51c-4981-b33b-aaf9b4587db7" returned: 0 in 0.502s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-192d2c35-3428-4640-a202-4a42953ed5bf tempest-VolumesActionsTest-541426287 None] Lock "cinder-quobyte-a0e53625-e51c-4981-b33b-aaf9b4587db7" released by "delete_volume" :: held 1.022s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Flow 'volume_create_manager' (0ee2b1e8-3847-4d82-b384-e2c296096863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf66625-5b14-4fa7-8136-37984bc1c95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf66625-5b14-4fa7-8136-37984bc1c95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1765504207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db7c9dae-36b4-4b7c-b668-571acbd5880c,host='devstack@QuobyteHD#QuobyteHD',id=2776193e-0aa7-4a65-be4e-cfcb4bf9e66d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92d06595be084c358cb2dcbbb6d9916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:56Z,use_quota=True,user_id='c095ce2da4ad4d169b5e9613d5cd56d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b649ccec-4c10-43b9-844a-a98507fe9461),volume_type_id=b649ccec-4c10-43b9-844a-a98507fe9461)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82215e96-e19b-4f2a-8993-c9591d63fd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82215e96-e19b-4f2a-8993-c9591d63fd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25882ffa-3973-4309-a1c6-df49c3ed1fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25882ffa-3973-4309-a1c6-df49c3ed1fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2776193e-0aa7-4a65-be4e-cfcb4bf9e66d', 'volume_name': 'volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9a844c-56bd-4ad0-ab7f-2ec28202bc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9a844c-56bd-4ad0-ab7f-2ec28202bc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4355ca8d-116e-422a-8b9b-aeb0e105825f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:55 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Volume 2776193e-0aa7-4a65-be4e-cfcb4bf9e66d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d', 'volume_size': 1} Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-192d2c35-3428-4640-a202-4a42953ed5bf tempest-VolumesActionsTest-541426287 None] Created reservations ['c772bd05-6dac-43dd-9e07-3583128090a4', 'e2faf9b3-bc06-4330-b9b5-d85d5e974fed', 'aca691df-3a44-4809-a652-7b01887ec183', 'cd040625-6817-4ee8-8cc7-562119ce0edf'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-192d2c35-3428-4640-a202-4a42953ed5bf tempest-VolumesActionsTest-541426287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-192d2c35-3428-4640-a202-4a42953ed5bf tempest-VolumesActionsTest-541426287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-192d2c35-3428-4640-a202-4a42953ed5bf tempest-VolumesActionsTest-541426287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-192d2c35-3428-4640-a202-4a42953ed5bf tempest-VolumesActionsTest-541426287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-192d2c35-3428-4640-a202-4a42953ed5bf tempest-VolumesActionsTest-541426287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-192d2c35-3428-4640-a202-4a42953ed5bf tempest-VolumesActionsTest-541426287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:55 devstack sudo[88109]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9f066b2c-c83d-4b79-abf5-aacc7cc1a528 tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.58ed495c-f9f6-42cb-9c51-94cc602497cc" returned: 0 in 0.627s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:55 devstack sudo[88147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:56:55 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9f066b2c-c83d-4b79-abf5-aacc7cc1a528 tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:55 devstack sudo[88149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.info Apr 21 20:56:55 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:56 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-192d2c35-3428-4640-a202-4a42953ed5bf tempest-VolumesActionsTest-541426287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.497s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:56 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-192d2c35-3428-4640-a202-4a42953ed5bf tempest-VolumesActionsTest-541426287 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:56 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-192d2c35-3428-4640-a202-4a42953ed5bf tempest-VolumesActionsTest-541426287 None] Deleted volume successfully. Apr 21 20:56:56 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-192d2c35-3428-4640-a202-4a42953ed5bf tempest-VolumesActionsTest-541426287 None] Lock "cinder-a0e53625-e51c-4981-b33b-aaf9b4587db7-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:56 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9f066b2c-c83d-4b79-abf5-aacc7cc1a528 tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.info" returned: 0 in 0.507s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:56 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-9f066b2c-c83d-4b79-abf5-aacc7cc1a528 tempest-VolumeDependencyTests-582766483 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.info is being set with open permissions: ugo+rw Apr 21 20:56:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9f066b2c-c83d-4b79-abf5-aacc7cc1a528 tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:56 devstack sudo[88153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.info Apr 21 20:56:56 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:56 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9f066b2c-c83d-4b79-abf5-aacc7cc1a528 tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.info" returned: 0 in 0.441s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9f066b2c-c83d-4b79-abf5-aacc7cc1a528 tempest-VolumeDependencyTests-582766483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.425s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.742s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1248730931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ef0cc7-8d02-409c-83d3-d4ed015cf77e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4289da88b9a0409dac1de908352bbc57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:52Z,use_quota=True,user_id='aa2fd890ddbd4389b9da649ed74e5892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Creating volume f6ef0cc7-8d02-409c-83d3-d4ed015cf77e {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:56 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:56:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:56 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e 1073741824 Apr 21 20:56:56 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:56 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-9f066b2c-c83d-4b79-abf5-aacc7cc1a528 tempest-VolumeDependencyTests-582766483 None] Create snapshot completed successfully Apr 21 20:56:57 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e 1073741824" returned: 0 in 0.585s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:57 devstack sudo[88161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e Apr 21 20:56:57 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Flow 'volume_create_manager' (38540433-e1cc-467f-ae89-1638354f8367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b445c2-10dd-4821-808f-c20a35c904f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b445c2-10dd-4821-808f-c20a35c904f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-40976836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ab0ac2c-b2a7-4365-a0a0-aeba23337518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e970cfed63f4e72b8d3e7877e653176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=58ed495c-f9f6-42cb-9c51-94cc602497cc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:58Z,use_quota=True,user_id='b090e29e06de4904848051c6c31fdcc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da8be7d-4eba-4ae4-9a30-5997c2066074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da8be7d-4eba-4ae4-9a30-5997c2066074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b46e00-051f-4b25-9e84-d330a4731541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b46e00-051f-4b25-9e84-d330a4731541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8ab0ac2c-b2a7-4365-a0a0-aeba23337518', 'volume_name': 'volume-8ab0ac2c-b2a7-4365-a0a0-aeba23337518', 'volume_size': 1, 'snapshot_id': '58ed495c-f9f6-42cb-9c51-94cc602497cc'}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1c770e-b312-46c6-b242-12d4491b3381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1c770e-b312-46c6-b242-12d4491b3381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (646a6600-0143-4ffe-8bb7-13e7fe974cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:57 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Volume 8ab0ac2c-b2a7-4365-a0a0-aeba23337518: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8ab0ac2c-b2a7-4365-a0a0-aeba23337518', 'volume_size': 1, 'snapshot_id': '58ed495c-f9f6-42cb-9c51-94cc602497cc'} Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:57 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e" returned: 0 in 0.442s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.144s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=db7c9dae-36b4-4b7c-b668-571acbd5880c,created_at=2026-04-21T18:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1765504207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db7c9dae-36b4-4b7c-b668-571acbd5880c,host='devstack@QuobyteHD#QuobyteHD',id=2776193e-0aa7-4a65-be4e-cfcb4bf9e66d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92d06595be084c358cb2dcbbb6d9916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:56Z,use_quota=True,user_id='c095ce2da4ad4d169b5e9613d5cd56d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b649ccec-4c10-43b9-844a-a98507fe9461),volume_type_id=b649ccec-4c10-43b9-844a-a98507fe9461)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Creating volume 2776193e-0aa7-4a65-be4e-cfcb4bf9e66d {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:58 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:56:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:58 devstack sudo[88164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d 1073741824 Apr 21 20:56:58 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:58 devstack cinder-volume[81957]: DEBUG cinder.volume.volume_utils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Attempting download of 1c112cf7-9f7d-490e-8e52-abb08838bafa ((None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}])) to volume f6ef0cc7-8d02-409c-83d3-d4ed015cf77e. {{(pid=81957) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 21 20:56:58 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5a7677-ddbc-4a9a-8755-c5ac05e46d9f]: (4, 'raw') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_tn82toot {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:58 devstack sudo[88167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_tn82toot Apr 21 20:56:58 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:58 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d 1073741824" returned: 0 in 0.568s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:58 devstack sudo[88174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d Apr 21 20:56:58 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:58 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_tn82toot" returned: 0 in 0.545s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_tn82toot {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:58 devstack sudo[88176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_tn82toot Apr 21 20:56:58 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:59 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d" returned: 0 in 0.533s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.160s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Acquiring lock "cinder-quobyte-58ed495c-f9f6-42cb-9c51-94cc602497cc-8ab0ac2c-b2a7-4365-a0a0-aeba23337518" by "_create_volume_from_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4355ca8d-116e-422a-8b9b-aeb0e105825f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f6d3a2-763d-4c9b-b032-85b460cfea9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Lock "cinder-quobyte-58ed495c-f9f6-42cb-9c51-94cc602497cc-8ab0ac2c-b2a7-4365-a0a0-aeba23337518" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Creating volume 8ab0ac2c-b2a7-4365-a0a0-aeba23337518 from snapshot 58ed495c-f9f6-42cb-9c51-94cc602497cc {{(pid=81957) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:59 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Acquiring lock "cinder-quobyte-8ab0ac2c-b2a7-4365-a0a0-aeba23337518" by "_copy_volume_from_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:59 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Volume volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d (2776193e-0aa7-4a65-be4e-cfcb4bf9e66d): created successfully Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f6d3a2-763d-4c9b-b032-85b460cfea9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Flow 'volume_create_manager' (0ee2b1e8-3847-4d82-b384-e2c296096863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_tn82toot" returned: 1 in 0.540s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c112cf7-9f7d-490e-8e52-abb08838bafa_tn82toot' failed. Not Retrying. {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3faef2-9274-47df-b211-dcb56f78596a]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_1e3j7yi6devstack@QuobyteHD {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Lock "cinder-quobyte-8ab0ac2c-b2a7-4365-a0a0-aeba23337518" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] snapshot: 58ed495c-f9f6-42cb-9c51-94cc602497cc, volume: 8ab0ac2c-b2a7-4365-a0a0-aeba23337518, {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:56:59 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-050ec7ef-5d72-4430-9ff2-02b8ead3d4f6 tempest-GroupSnapshotsTest-759127538 None] Created volume successfully. Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f7c63a-fd85-4900-be26-cd09dfcd1993]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.58ed495c-f9f6-42cb-9c51-94cc602497cc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:59 devstack sudo[88182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_1e3j7yi6devstack@QuobyteHD Apr 21 20:56:59 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:59 devstack sudo[88183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.58ed495c-f9f6-42cb-9c51-94cc602497cc Apr 21 20:56:59 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:59 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_1e3j7yi6devstack@QuobyteHD" returned: 0 in 0.549s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] 1c112cf7-9f7d-490e-8e52-abb08838bafa was qcow2, converting to raw {{(pid=81957) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_1e3j7yi6devstack@QuobyteHD /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:59 devstack sudo[88193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_1e3j7yi6devstack@QuobyteHD /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e Apr 21 20:56:59 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:59 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.58ed495c-f9f6-42cb-9c51-94cc602497cc" returned: 0 in 0.594s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Creating direct copy from snapshot {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a612d5-ed85-4a43-9ce5-edad28c0a9ae]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:59 devstack sudo[88195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 Apr 21 20:56:59 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:00 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-f50072c4-69a1-4432-9a21-f101508bf301 tempest-GroupSnapshotsTest-759127538 None] GroupSnapshot 27c4f449-3497-4e7e-8e70-2fcf3eec9daf: creating. Apr 21 20:57:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f50072c4-69a1-4432-9a21-f101508bf301 tempest-GroupSnapshotsTest-759127538 None] Group snapshot 27c4f449-3497-4e7e-8e70-2fcf3eec9daf: creating. {{(pid=81957) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 21 20:57:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f50072c4-69a1-4432-9a21-f101508bf301 tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:00 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768" returned: 0 in 0.641s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:00 devstack cinder-volume[81957]: DEBUG cinder.utils [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Path /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8ab0ac2c-b2a7-4365-a0a0-aeba23337518 not found in is_blk_device check {{(pid=81957) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:57:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8ab0ac2c-b2a7-4365-a0a0-aeba23337518 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:00 devstack sudo[88212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8ab0ac2c-b2a7-4365-a0a0-aeba23337518 Apr 21 20:57:00 devstack sudo[88212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:00 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_1e3j7yi6devstack@QuobyteHD /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e" returned: 0 in 1.176s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:00 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1c112cf7-9f7d-490e-8e52-abb08838bafa_1e3j7yi6devstack@QuobyteHD, size 112.00 MB, duration 1.18 sec, destination /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e {{(pid=81957) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:57:00 devstack cinder-volume[81957]: INFO cinder.image.image_utils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Converted 112.00 MB image at 95.14 MB/s Apr 21 20:57:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:00 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e 1G Apr 21 20:57:00 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:01 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Flow 'volume_create_manager' (59035418-943b-4683-8f88-9c44255fb54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a5203f-4bf2-44c8-8028-1cc9f2f294eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a5203f-4bf2-44c8-8028-1cc9f2f294eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1786556895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1399527b-9a9f-40d4-9949-fe7514ca0e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa315bf154b4791b5255a568dadeee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:01Z,use_quota=True,user_id='e74df83b9ee64d11b8d6f0b6447b3e25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (083c0a7e-57bc-435d-8093-ef1589874f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (083c0a7e-57bc-435d-8093-ef1589874f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:01 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba90360-923c-4aee-9227-7d66cd67a43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba90360-923c-4aee-9227-7d66cd67a43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1399527b-9a9f-40d4-9949-fe7514ca0e95', 'volume_name': 'volume-1399527b-9a9f-40d4-9949-fe7514ca0e95', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4292978f-830c-4311-9095-810eaa0cc341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4292978f-830c-4311-9095-810eaa0cc341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0adcb978-19a3-4c60-bdc8-4b91c8eb29a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:01 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Volume 1399527b-9a9f-40d4-9949-fe7514ca0e95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1399527b-9a9f-40d4-9949-fe7514ca0e95', 'volume_size': 1} Apr 21 20:57:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e 1G" returned: 0 in 0.902s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:01 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd89878-2f55-488e-b98b-34f88bbbf959]: (4, 'raw') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:02 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e Apr 21 20:57:02 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:02 devstack sudo[88212]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8ab0ac2c-b2a7-4365-a0a0-aeba23337518" returned: 0 in 2.331s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:02 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51461a5-c740-471d-931c-eba701a15da3]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:02 devstack sudo[88232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 Apr 21 20:57:02 devstack sudo[88232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:02 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e" returned: 0 in 1.041s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:03 devstack sudo[88236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e Apr 21 20:57:03 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:03 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e" returned: 1 in 0.485s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e' failed. Not Retrying. {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG cinder.volume.volume_utils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Downloaded image 1c112cf7-9f7d-490e-8e52-abb08838bafa ((None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}])) to volume f6ef0cc7-8d02-409c-83d3-d4ed015cf77e successfully. {{(pid=81957) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Temporary image 1c112cf7-9f7d-490e-8e52-abb08838bafa for user aa2fd890ddbd4389b9da649ed74e5892 is deleted. {{(pid=81957) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG cinder.volume.volume_utils [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Marking volume f6ef0cc7-8d02-409c-83d3-d4ed015cf77e as bootable. {{(pid=81957) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 21 20:57:03 devstack sudo[88232]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Copying metadata from image 1c112cf7-9f7d-490e-8e52-abb08838bafa to f6ef0cc7-8d02-409c-83d3-d4ed015cf77e. {{(pid=81957) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Creating volume glance metadata for volume f6ef0cc7-8d02-409c-83d3-d4ed015cf77e backed by image 1c112cf7-9f7d-490e-8e52-abb08838bafa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81957) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768" returned: 0 in 0.641s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768, size 1024.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8ab0ac2c-b2a7-4365-a0a0-aeba23337518 {{(pid=81957) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:57:03 devstack cinder-volume[81957]: INFO cinder.image.image_utils [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Converted 1024.00 MB image at 439.12 MB/s Apr 21 20:57:03 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8ab0ac2c-b2a7-4365-a0a0-aeba23337518 is being set with open permissions: ugo+rw Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8ab0ac2c-b2a7-4365-a0a0-aeba23337518 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:03 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8ab0ac2c-b2a7-4365-a0a0-aeba23337518 Apr 21 20:57:03 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e40a63c-4608-4b54-a404-5bf081aeac52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e', 'volume_size': 1, 'image_id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c112cf7-9f7d-490e-8e52-abb08838bafa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea9a1f20637b41ec8f283a778363aed0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1c112cf7-9f7d-490e-8e52-abb08838bafa', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c112cf7-9f7d-490e-8e52-abb08838bafa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7743b8-ce8d-4d7d-a150-73b428750ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:03 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Volume volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e (f6ef0cc7-8d02-409c-83d3-d4ed015cf77e): created successfully Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7743b8-ce8d-4d7d-a150-73b428750ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Flow 'volume_create_manager' (897fdb2a-7043-49e9-b69b-a7b25a80da67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:03 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-040ac2b0-7ae6-4e31-8098-673b22ae686f tempest-VolumesGetTest-967003488 None] Created volume successfully. Apr 21 20:57:03 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8ab0ac2c-b2a7-4365-a0a0-aeba23337518" returned: 0 in 0.430s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Lock "cinder-quobyte-8ab0ac2c-b2a7-4365-a0a0-aeba23337518" released by "_copy_volume_from_snapshot" :: held 4.701s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Lock "cinder-quobyte-58ed495c-f9f6-42cb-9c51-94cc602497cc-8ab0ac2c-b2a7-4365-a0a0-aeba23337518" released by "_create_volume_from_snapshot" :: held 4.741s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.765s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f50072c4-69a1-4432-9a21-f101508bf301 tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.565s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-f50072c4-69a1-4432-9a21-f101508bf301 tempest-GroupSnapshotsTest-759127538 None] Creating offline snapshot 7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b of volume 2776193e-0aa7-4a65-be4e-cfcb4bf9e66d {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (646a6600-0143-4ffe-8bb7-13e7fe974cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ab0ac2c-b2a7-4365-a0a0-aeba23337518', 'volume_size': 1, 'snapshot_id': '58ed495c-f9f6-42cb-9c51-94cc602497cc'}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847fc18a-56ab-41d8-b8e4-5c138a114e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa114694-11f1-4602-8116-751cb02b02a3]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f50072c4-69a1-4432-9a21-f101508bf301 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:03 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Volume volume-8ab0ac2c-b2a7-4365-a0a0-aeba23337518 (8ab0ac2c-b2a7-4365-a0a0-aeba23337518): created successfully Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847fc18a-56ab-41d8-b8e4-5c138a114e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:03 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Flow 'volume_create_manager' (38540433-e1cc-467f-ae89-1638354f8367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:03 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-900f199e-c78b-44a8-aa1a-68e0d1c7ef0b tempest-VolumeDependencyTests-582766483 None] Created volume successfully. Apr 21 20:57:04 devstack sudo[88247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d Apr 21 20:57:04 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-de39b750-38fe-4e22-bd22-5f9d0e617521 tempest-VolumeDependencyTests-582766483 None] Acquiring lock "cinder-58ed495c-f9f6-42cb-9c51-94cc602497cc-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-de39b750-38fe-4e22-bd22-5f9d0e617521 tempest-VolumeDependencyTests-582766483 None] Lock "cinder-58ed495c-f9f6-42cb-9c51-94cc602497cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-de39b750-38fe-4e22-bd22-5f9d0e617521 tempest-VolumeDependencyTests-582766483 None] Acquiring lock "cinder-quobyte-7e06b3e8-a0ed-4466-879b-bcbce97d7768" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-de39b750-38fe-4e22-bd22-5f9d0e617521 tempest-VolumeDependencyTests-582766483 None] Lock "cinder-quobyte-7e06b3e8-a0ed-4466-879b-bcbce97d7768" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-de39b750-38fe-4e22-bd22-5f9d0e617521 tempest-VolumeDependencyTests-582766483 None] Acquiring lock "cinder-quobyte-58ed495c-f9f6-42cb-9c51-94cc602497cc" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-de39b750-38fe-4e22-bd22-5f9d0e617521 tempest-VolumeDependencyTests-582766483 None] Lock "cinder-quobyte-58ed495c-f9f6-42cb-9c51-94cc602497cc" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-de39b750-38fe-4e22-bd22-5f9d0e617521 tempest-VolumeDependencyTests-582766483 None] Deleting offline snapshot 58ed495c-f9f6-42cb-9c51-94cc602497cc of volume 7e06b3e8-a0ed-4466-879b-bcbce97d7768 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-de39b750-38fe-4e22-bd22-5f9d0e617521 tempest-VolumeDependencyTests-582766483 None] snapshot_file for this snap is: volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.58ed495c-f9f6-42cb-9c51-94cc602497cc {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a959c0-4072-4776-9cdb-26273a991aa9]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-de39b750-38fe-4e22-bd22-5f9d0e617521 tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.58ed495c-f9f6-42cb-9c51-94cc602497cc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:04 devstack sudo[88251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.58ed495c-f9f6-42cb-9c51-94cc602497cc Apr 21 20:57:04 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:04 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f50072c4-69a1-4432-9a21-f101508bf301 tempest-GroupSnapshotsTest-759127538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d" returned: 0 in 0.530s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f50072c4-69a1-4432-9a21-f101508bf301 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:04 devstack sudo[88256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b 1G Apr 21 20:57:04 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Flow 'volume_create_manager' (6451f303-ad0d-471c-96c8-d949247a5e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cdb3c82-9488-4a9d-a944-808c3f037653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cdb3c82-9488-4a9d-a944-808c3f037653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-319163207',display_name='tempest-VolumesGetTest-Volume-375362889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60cca48c-be34-481b-85e3-9ffe6a507a94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4289da88b9a0409dac1de908352bbc57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:05Z,use_quota=True,user_id='aa2fd890ddbd4389b9da649ed74e5892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f4fb9cc-01d3-4325-a63d-ffafd55261fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f4fb9cc-01d3-4325-a63d-ffafd55261fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aeb8b1d-03c2-46f5-8143-d0140f029183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aeb8b1d-03c2-46f5-8143-d0140f029183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60cca48c-be34-481b-85e3-9ffe6a507a94', 'volume_name': 'volume-60cca48c-be34-481b-85e3-9ffe6a507a94', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2875cd6-9c5c-4d0b-b579-afb69d733199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2875cd6-9c5c-4d0b-b579-afb69d733199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2000dfb-9510-4caf-a5ab-487499ab060e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:04 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Volume 60cca48c-be34-481b-85e3-9ffe6a507a94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60cca48c-be34-481b-85e3-9ffe6a507a94', 'volume_size': 1} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:04 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-de39b750-38fe-4e22-bd22-5f9d0e617521 tempest-VolumeDependencyTests-582766483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.58ed495c-f9f6-42cb-9c51-94cc602497cc" returned: 0 in 0.561s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-de39b750-38fe-4e22-bd22-5f9d0e617521 tempest-VolumeDependencyTests-582766483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdf3ab0-2d6e-4278-84bf-19e9bf309711]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-de39b750-38fe-4e22-bd22-5f9d0e617521 tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:04 devstack sudo[88263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 Apr 21 20:57:04 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:04 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f50072c4-69a1-4432-9a21-f101508bf301 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b 1G" returned: 0 in 0.516s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f50072c4-69a1-4432-9a21-f101508bf301 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:05 devstack sudo[88266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b Apr 21 20:57:05 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:05 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-de39b750-38fe-4e22-bd22-5f9d0e617521 tempest-VolumeDependencyTests-582766483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768" returned: 0 in 0.536s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-de39b750-38fe-4e22-bd22-5f9d0e617521 tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.58ed495c-f9f6-42cb-9c51-94cc602497cc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:05 devstack sudo[88274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.58ed495c-f9f6-42cb-9c51-94cc602497cc Apr 21 20:57:05 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:05 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f50072c4-69a1-4432-9a21-f101508bf301 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b" returned: 0 in 0.423s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:05 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-f50072c4-69a1-4432-9a21-f101508bf301 tempest-GroupSnapshotsTest-759127538 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:57:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f50072c4-69a1-4432-9a21-f101508bf301 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:05 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b Apr 21 20:57:05 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:05 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-de39b750-38fe-4e22-bd22-5f9d0e617521 tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.58ed495c-f9f6-42cb-9c51-94cc602497cc" returned: 0 in 0.449s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-de39b750-38fe-4e22-bd22-5f9d0e617521 tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.58ed495c-f9f6-42cb-9c51-94cc602497cc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:05 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f50072c4-69a1-4432-9a21-f101508bf301 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b" returned: 0 in 0.426s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:05 devstack sudo[88282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.58ed495c-f9f6-42cb-9c51-94cc602497cc Apr 21 20:57:05 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f50072c4-69a1-4432-9a21-f101508bf301 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:05 devstack sudo[88284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.info Apr 21 20:57:05 devstack sudo[88284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:06 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-de39b750-38fe-4e22-bd22-5f9d0e617521 tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768.58ed495c-f9f6-42cb-9c51-94cc602497cc" returned: 0 in 0.391s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:06 devstack sudo[88284]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:06 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-de39b750-38fe-4e22-bd22-5f9d0e617521 tempest-VolumeDependencyTests-582766483 None] Lock "cinder-quobyte-58ed495c-f9f6-42cb-9c51-94cc602497cc" released by "_delete_snapshot" :: held 1.993s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f50072c4-69a1-4432-9a21-f101508bf301 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.info" returned: 0 in 0.389s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:06 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-f50072c4-69a1-4432-9a21-f101508bf301 tempest-GroupSnapshotsTest-759127538 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:57:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f50072c4-69a1-4432-9a21-f101508bf301 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:06 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-de39b750-38fe-4e22-bd22-5f9d0e617521 tempest-VolumeDependencyTests-582766483 None] Lock "cinder-quobyte-7e06b3e8-a0ed-4466-879b-bcbce97d7768" released by "delete_snapshot" :: held 2.015s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:06 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.info Apr 21 20:57:06 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:06 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-de39b750-38fe-4e22-bd22-5f9d0e617521 tempest-VolumeDependencyTests-582766483 None] Created reservations ['3e76355f-b951-42b2-8c80-41e13cbd8055', '5c713a7a-8326-4c4a-b7af-f1efdb58cb49', 'e16f672f-ea3e-476b-a13b-113f48262d08', '9e2093fd-7b7a-42e8-af26-8a3bfa4acc6c'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:06 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-de39b750-38fe-4e22-bd22-5f9d0e617521 tempest-VolumeDependencyTests-582766483 None] Delete snapshot completed successfully. Apr 21 20:57:06 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-de39b750-38fe-4e22-bd22-5f9d0e617521 tempest-VolumeDependencyTests-582766483 None] Lock "cinder-58ed495c-f9f6-42cb-9c51-94cc602497cc-delete_snapshot" released by "delete_snapshot" :: held 2.105s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:06 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f50072c4-69a1-4432-9a21-f101508bf301 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.info" returned: 0 in 0.409s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f50072c4-69a1-4432-9a21-f101508bf301 tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.773s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.865s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1786556895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1399527b-9a9f-40d4-9949-fe7514ca0e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa315bf154b4791b5255a568dadeee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:01Z,use_quota=True,user_id='e74df83b9ee64d11b8d6f0b6447b3e25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Creating volume 1399527b-9a9f-40d4-9949-fe7514ca0e95 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:06 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:57:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:06 devstack sudo[88291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95 1073741824 Apr 21 20:57:06 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:06 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-f50072c4-69a1-4432-9a21-f101508bf301 tempest-GroupSnapshotsTest-759127538 None] group_snapshot 27c4f449-3497-4e7e-8e70-2fcf3eec9daf: created successfully Apr 21 20:57:07 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95 1073741824" returned: 0 in 0.452s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:07 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95 Apr 21 20:57:07 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-08bca25c-916c-4ff7-85c2-09dcc6d0f5e3 tempest-VolumeDependencyTests-582766483 None] Acquiring lock "cinder-7e06b3e8-a0ed-4466-879b-bcbce97d7768-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-08bca25c-916c-4ff7-85c2-09dcc6d0f5e3 tempest-VolumeDependencyTests-582766483 None] Lock "cinder-7e06b3e8-a0ed-4466-879b-bcbce97d7768-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-08bca25c-916c-4ff7-85c2-09dcc6d0f5e3 tempest-VolumeDependencyTests-582766483 None] Acquiring lock "cinder-quobyte-7e06b3e8-a0ed-4466-879b-bcbce97d7768" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-08bca25c-916c-4ff7-85c2-09dcc6d0f5e3 tempest-VolumeDependencyTests-582766483 None] Lock "cinder-quobyte-7e06b3e8-a0ed-4466-879b-bcbce97d7768" acquired by "delete_volume" :: waited 0.013s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35e55c4-3bd5-4f43-8a7e-8bbe423c6de3]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-08bca25c-916c-4ff7-85c2-09dcc6d0f5e3 tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:07 devstack sudo[88298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 Apr 21 20:57:07 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:07 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95" returned: 0 in 0.417s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.907s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-319163207',display_name='tempest-VolumesGetTest-Volume-375362889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60cca48c-be34-481b-85e3-9ffe6a507a94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4289da88b9a0409dac1de908352bbc57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:05Z,use_quota=True,user_id='aa2fd890ddbd4389b9da649ed74e5892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Creating volume 60cca48c-be34-481b-85e3-9ffe6a507a94 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:07 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-60cca48c-be34-481b-85e3-9ffe6a507a94 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0adcb978-19a3-4c60-bdc8-4b91c8eb29a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1399527b-9a9f-40d4-9949-fe7514ca0e95', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:07 devstack sudo[88301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-60cca48c-be34-481b-85e3-9ffe6a507a94 1073741824 Apr 21 20:57:07 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9ef52e-0423-44d2-ae38-f21dbd280b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:07 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Volume volume-1399527b-9a9f-40d4-9949-fe7514ca0e95 (1399527b-9a9f-40d4-9949-fe7514ca0e95): created successfully Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9ef52e-0423-44d2-ae38-f21dbd280b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Flow 'volume_create_manager' (59035418-943b-4683-8f88-9c44255fb54a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:07 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-7f82ef34-b4ac-4dc9-a12b-37b95307aa8b tempest-VolumesSnapshotListTestJSON-1852241632 None] Created volume successfully. Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-cb76c738-fa72-4576-9fde-9060f44b9e2c tempest-VolumesSnapshotListTestJSON-1852241632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:07 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-08bca25c-916c-4ff7-85c2-09dcc6d0f5e3 tempest-VolumeDependencyTests-582766483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768" returned: 0 in 0.527s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-08bca25c-916c-4ff7-85c2-09dcc6d0f5e3 tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:07 devstack sudo[88306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768 Apr 21 20:57:07 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:08 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-60cca48c-be34-481b-85e3-9ffe6a507a94 1073741824" returned: 0 in 0.531s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-60cca48c-be34-481b-85e3-9ffe6a507a94 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:08 devstack sudo[88311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-60cca48c-be34-481b-85e3-9ffe6a507a94 Apr 21 20:57:08 devstack sudo[88311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:08 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-08bca25c-916c-4ff7-85c2-09dcc6d0f5e3 tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7e06b3e8-a0ed-4466-879b-bcbce97d7768" returned: 0 in 0.428s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-08bca25c-916c-4ff7-85c2-09dcc6d0f5e3 tempest-VolumeDependencyTests-582766483 None] Lock "cinder-quobyte-7e06b3e8-a0ed-4466-879b-bcbce97d7768" released by "delete_volume" :: held 0.982s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-08bca25c-916c-4ff7-85c2-09dcc6d0f5e3 tempest-VolumeDependencyTests-582766483 None] Created reservations ['a2f84976-fa2f-4bc9-b680-fb8321a0cef4', 'e2c2f221-3abb-4a6c-8043-9d0c0087ddf5', 'd4bdffb1-125c-4ac0-99d0-af0216fee0f7', '5c089865-d925-4160-a0f7-d97b8c376c22'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-08bca25c-916c-4ff7-85c2-09dcc6d0f5e3 tempest-VolumeDependencyTests-582766483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-08bca25c-916c-4ff7-85c2-09dcc6d0f5e3 tempest-VolumeDependencyTests-582766483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-08bca25c-916c-4ff7-85c2-09dcc6d0f5e3 tempest-VolumeDependencyTests-582766483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-08bca25c-916c-4ff7-85c2-09dcc6d0f5e3 tempest-VolumeDependencyTests-582766483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-08bca25c-916c-4ff7-85c2-09dcc6d0f5e3 tempest-VolumeDependencyTests-582766483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-08bca25c-916c-4ff7-85c2-09dcc6d0f5e3 tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:08 devstack sudo[88315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:57:08 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:08 devstack sudo[88311]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-60cca48c-be34-481b-85e3-9ffe6a507a94" returned: 0 in 0.436s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-cb76c738-fa72-4576-9fde-9060f44b9e2c tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.648s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2000dfb-9510-4caf-a5ab-487499ab060e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60cca48c-be34-481b-85e3-9ffe6a507a94', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6210bd04-3dff-4186-b7cf-4c59c1aae1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:08 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Volume volume-60cca48c-be34-481b-85e3-9ffe6a507a94 (60cca48c-be34-481b-85e3-9ffe6a507a94): created successfully Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6210bd04-3dff-4186-b7cf-4c59c1aae1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Flow 'volume_create_manager' (6451f303-ad0d-471c-96c8-d949247a5e7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-cb76c738-fa72-4576-9fde-9060f44b9e2c tempest-VolumesSnapshotListTestJSON-1852241632 None] Creating offline snapshot dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 of volume 1399527b-9a9f-40d4-9949-fe7514ca0e95 {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[2777d468-5389-435d-9fe1-bda5c98ffde5]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-cb76c738-fa72-4576-9fde-9060f44b9e2c tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:08 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-b78def83-755d-4e12-bf1d-944e04ae1e5c tempest-VolumesGetTest-967003488 None] Created volume successfully. Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:08 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95 Apr 21 20:57:08 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-d5d75584-14a2-4944-b4a9-352818438959 tempest-VolumesGetTest-967003488 None] Acquiring lock "cinder-60cca48c-be34-481b-85e3-9ffe6a507a94-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-d5d75584-14a2-4944-b4a9-352818438959 tempest-VolumesGetTest-967003488 None] Lock "cinder-60cca48c-be34-481b-85e3-9ffe6a507a94-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-d5d75584-14a2-4944-b4a9-352818438959 tempest-VolumesGetTest-967003488 None] Acquiring lock "cinder-quobyte-60cca48c-be34-481b-85e3-9ffe6a507a94" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-d5d75584-14a2-4944-b4a9-352818438959 tempest-VolumesGetTest-967003488 None] Lock "cinder-quobyte-60cca48c-be34-481b-85e3-9ffe6a507a94" acquired by "delete_volume" :: waited 0.006s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba901649-d263-4570-a242-35652387b301]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d5d75584-14a2-4944-b4a9-352818438959 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-60cca48c-be34-481b-85e3-9ffe6a507a94 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:08 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-08bca25c-916c-4ff7-85c2-09dcc6d0f5e3 tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.478s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:08 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-08bca25c-916c-4ff7-85c2-09dcc6d0f5e3 tempest-VolumeDependencyTests-582766483 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:08 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-08bca25c-916c-4ff7-85c2-09dcc6d0f5e3 tempest-VolumeDependencyTests-582766483 None] Deleted volume successfully. Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-08bca25c-916c-4ff7-85c2-09dcc6d0f5e3 tempest-VolumeDependencyTests-582766483 None] Lock "cinder-7e06b3e8-a0ed-4466-879b-bcbce97d7768-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:09 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-60cca48c-be34-481b-85e3-9ffe6a507a94 Apr 21 20:57:09 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:09 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-cb76c738-fa72-4576-9fde-9060f44b9e2c tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95" returned: 0 in 0.551s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-cb76c738-fa72-4576-9fde-9060f44b9e2c tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:09 devstack sudo[88326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 1G Apr 21 20:57:09 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:09 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d5d75584-14a2-4944-b4a9-352818438959 tempest-VolumesGetTest-967003488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-60cca48c-be34-481b-85e3-9ffe6a507a94" returned: 0 in 0.474s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d5d75584-14a2-4944-b4a9-352818438959 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-60cca48c-be34-481b-85e3-9ffe6a507a94 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:09 devstack sudo[88331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-60cca48c-be34-481b-85e3-9ffe6a507a94 Apr 21 20:57:09 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:09 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-cb76c738-fa72-4576-9fde-9060f44b9e2c tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 1G" returned: 0 in 0.508s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-cb76c738-fa72-4576-9fde-9060f44b9e2c tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1399527b-9a9f-40d4-9949-fe7514ca0e95 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:09 devstack sudo[88336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1399527b-9a9f-40d4-9949-fe7514ca0e95 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 Apr 21 20:57:09 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Flow 'volume_create_manager' (f431d7ff-9a6a-4b86-838f-48d4e5b6d655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dec8cff-a60a-4924-aae0-566feb00a573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dec8cff-a60a-4924-aae0-566feb00a573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1505943102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae042b10-267f-4ddc-83a4-bc40a4b4e395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e970cfed63f4e72b8d3e7877e653176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:10Z,use_quota=True,user_id='b090e29e06de4904848051c6c31fdcc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2be796-c0e2-4641-b64c-28219ff03ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2be796-c0e2-4641-b64c-28219ff03ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ebd8a1-66e9-4d69-b2c5-bf1defc1f1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ebd8a1-66e9-4d69-b2c5-bf1defc1f1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae042b10-267f-4ddc-83a4-bc40a4b4e395', 'volume_name': 'volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9072220-b90b-4c0f-8bb1-9863d1eaceb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9072220-b90b-4c0f-8bb1-9863d1eaceb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1d690f-6deb-4fbf-bb22-24f6515ef31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:09 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Volume ae042b10-267f-4ddc-83a4-bc40a4b4e395: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395', 'volume_size': 1} Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:09 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d5d75584-14a2-4944-b4a9-352818438959 tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-60cca48c-be34-481b-85e3-9ffe6a507a94" returned: 0 in 0.453s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-d5d75584-14a2-4944-b4a9-352818438959 tempest-VolumesGetTest-967003488 None] Lock "cinder-quobyte-60cca48c-be34-481b-85e3-9ffe6a507a94" released by "delete_volume" :: held 0.945s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-d5d75584-14a2-4944-b4a9-352818438959 tempest-VolumesGetTest-967003488 None] Created reservations ['c6d7db57-17fe-4d81-8a68-68406f754146', '0f51575d-bfa3-4b64-97a1-92c7c8e30a51', 'a46edaa3-4a61-48ed-b3f4-19d4ba58439e', 'f3bb6d28-8806-4b53-9300-a90e7f021d28'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d5d75584-14a2-4944-b4a9-352818438959 tempest-VolumesGetTest-967003488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d5d75584-14a2-4944-b4a9-352818438959 tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d5d75584-14a2-4944-b4a9-352818438959 tempest-VolumesGetTest-967003488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d5d75584-14a2-4944-b4a9-352818438959 tempest-VolumesGetTest-967003488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d5d75584-14a2-4944-b4a9-352818438959 tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d5d75584-14a2-4944-b4a9-352818438959 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:10 devstack sudo[88339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:57:10 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:10 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3bf7826c-b17b-4e1c-9091-92b3119070b3 tempest-VolumesGetTest-967003488 None] Acquiring lock "cinder-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:10 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3bf7826c-b17b-4e1c-9091-92b3119070b3 tempest-VolumesGetTest-967003488 None] Lock "cinder-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:10 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3bf7826c-b17b-4e1c-9091-92b3119070b3 tempest-VolumesGetTest-967003488 None] Acquiring lock "cinder-quobyte-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:10 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3bf7826c-b17b-4e1c-9091-92b3119070b3 tempest-VolumesGetTest-967003488 None] Lock "cinder-quobyte-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:10 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-cb76c738-fa72-4576-9fde-9060f44b9e2c tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1399527b-9a9f-40d4-9949-fe7514ca0e95 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77" returned: 0 in 0.494s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:10 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-cb76c738-fa72-4576-9fde-9060f44b9e2c tempest-VolumesSnapshotListTestJSON-1852241632 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 is being set with open permissions: ugo+rw Apr 21 20:57:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-cb76c738-fa72-4576-9fde-9060f44b9e2c tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:10 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ebc312-4b84-47c6-9938-b57491aeb159]: (4, 'raw') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3bf7826c-b17b-4e1c-9091-92b3119070b3 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:10 devstack sudo[88344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 Apr 21 20:57:10 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:10 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e Apr 21 20:57:10 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:10 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d5d75584-14a2-4944-b4a9-352818438959 tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.444s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:10 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-d5d75584-14a2-4944-b4a9-352818438959 tempest-VolumesGetTest-967003488 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:10 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-d5d75584-14a2-4944-b4a9-352818438959 tempest-VolumesGetTest-967003488 None] Deleted volume successfully. Apr 21 20:57:10 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-d5d75584-14a2-4944-b4a9-352818438959 tempest-VolumesGetTest-967003488 None] Lock "cinder-60cca48c-be34-481b-85e3-9ffe6a507a94-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:10 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-cb76c738-fa72-4576-9fde-9060f44b9e2c tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77" returned: 0 in 0.389s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-cb76c738-fa72-4576-9fde-9060f44b9e2c tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:10 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.info Apr 21 20:57:10 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:10 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3bf7826c-b17b-4e1c-9091-92b3119070b3 tempest-VolumesGetTest-967003488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e" returned: 0 in 0.462s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3bf7826c-b17b-4e1c-9091-92b3119070b3 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:10 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e Apr 21 20:57:10 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:11 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-cb76c738-fa72-4576-9fde-9060f44b9e2c tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.info" returned: 0 in 0.426s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:11 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-cb76c738-fa72-4576-9fde-9060f44b9e2c tempest-VolumesSnapshotListTestJSON-1852241632 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.info is being set with open permissions: ugo+rw Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-cb76c738-fa72-4576-9fde-9060f44b9e2c tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:11 devstack sudo[88357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.info Apr 21 20:57:11 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:11 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3bf7826c-b17b-4e1c-9091-92b3119070b3 tempest-VolumesGetTest-967003488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e" returned: 1 in 0.460s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3bf7826c-b17b-4e1c-9091-92b3119070b3 tempest-VolumesGetTest-967003488 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e' failed. Not Retrying. {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3bf7826c-b17b-4e1c-9091-92b3119070b3 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:11 devstack sudo[88362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e Apr 21 20:57:11 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:11 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-cb76c738-fa72-4576-9fde-9060f44b9e2c tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.info" returned: 0 in 0.426s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-cb76c738-fa72-4576-9fde-9060f44b9e2c tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.877s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.773s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "cinder-quobyte-7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b-efcf5660-e10d-4c25-b3a8-0b107ec48082" by "_create_volume_from_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b-efcf5660-e10d-4c25-b3a8-0b107ec48082" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Creating volume efcf5660-e10d-4c25-b3a8-0b107ec48082 from snapshot 7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b {{(pid=81957) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "cinder-quobyte-efcf5660-e10d-4c25-b3a8-0b107ec48082" by "_copy_volume_from_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:11 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-cb76c738-fa72-4576-9fde-9060f44b9e2c tempest-VolumesSnapshotListTestJSON-1852241632 None] Create snapshot completed successfully Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-efcf5660-e10d-4c25-b3a8-0b107ec48082" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] snapshot: 7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b, volume: efcf5660-e10d-4c25-b3a8-0b107ec48082, {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9925c79-d0d5-4a35-be82-f2ff4dd02deb]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:11 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3bf7826c-b17b-4e1c-9091-92b3119070b3 tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e" returned: 0 in 0.422s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3bf7826c-b17b-4e1c-9091-92b3119070b3 tempest-VolumesGetTest-967003488 None] Lock "cinder-quobyte-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e" released by "delete_volume" :: held 1.391s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-3bf7826c-b17b-4e1c-9091-92b3119070b3 tempest-VolumesGetTest-967003488 None] Created reservations ['8e2717ad-46aa-4206-a7f2-5d51986fdc26', 'c4b41249-6c56-4f7c-aa1e-1df9db34fafe', 'c27297de-3dbe-4c94-bd95-b68efea393e7', '73afcfa4-a838-4b0f-aee3-24283114b729'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:11 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b Apr 21 20:57:11 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3bf7826c-b17b-4e1c-9091-92b3119070b3 tempest-VolumesGetTest-967003488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3bf7826c-b17b-4e1c-9091-92b3119070b3 tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3bf7826c-b17b-4e1c-9091-92b3119070b3 tempest-VolumesGetTest-967003488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3bf7826c-b17b-4e1c-9091-92b3119070b3 tempest-VolumesGetTest-967003488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3bf7826c-b17b-4e1c-9091-92b3119070b3 tempest-VolumesGetTest-967003488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3bf7826c-b17b-4e1c-9091-92b3119070b3 tempest-VolumesGetTest-967003488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:11 devstack sudo[88368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:57:11 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:12 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b" returned: 0 in 0.490s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:12 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:12 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:57:12 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Creating direct copy from snapshot {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:57:12 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1ba483-d29b-43db-a599-dc7898920249]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:12 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3bf7826c-b17b-4e1c-9091-92b3119070b3 tempest-VolumesGetTest-967003488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.446s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:12 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-3bf7826c-b17b-4e1c-9091-92b3119070b3 tempest-VolumesGetTest-967003488 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:12 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-3bf7826c-b17b-4e1c-9091-92b3119070b3 tempest-VolumesGetTest-967003488 None] Deleted volume successfully. Apr 21 20:57:12 devstack sudo[88374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d Apr 21 20:57:12 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:12 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3bf7826c-b17b-4e1c-9091-92b3119070b3 tempest-VolumesGetTest-967003488 None] Lock "cinder-f6ef0cc7-8d02-409c-83d3-d4ed015cf77e-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c1de87ff-f43e-4863-b8c4-9d46fadd9904 tempest-VolumesSnapshotListTestJSON-1852241632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:12 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d" returned: 0 in 0.528s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:12 devstack cinder-volume[81957]: DEBUG cinder.utils [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Path /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-efcf5660-e10d-4c25-b3a8-0b107ec48082 not found in is_blk_device check {{(pid=81957) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:57:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-efcf5660-e10d-4c25-b3a8-0b107ec48082 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:12 devstack sudo[88379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-efcf5660-e10d-4c25-b3a8-0b107ec48082 Apr 21 20:57:12 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:14 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-efcf5660-e10d-4c25-b3a8-0b107ec48082" returned: 0 in 2.120s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:14 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b5df13-96a4-4b9c-9728-4d4577c8ccf8]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:14 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d Apr 21 20:57:14 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:14 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Flow 'volume_create_manager' (f5c6fd71-1c6d-45bf-88ec-ab9dc3279972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85001f8c-2945-4b41-ac1e-3b696dfc7be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85001f8c-2945-4b41-ac1e-3b696dfc7be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1082577581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b11ba953-c104-4b24-a257-1c9147fbe895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e12368462240d2b8a0590901c7de15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:15Z,use_quota=True,user_id='b2042c863d91495099eb4500945ba4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af27146f-ae99-4c31-805f-0c8b64da983b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af27146f-ae99-4c31-805f-0c8b64da983b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b0ac5d-4d73-4dd4-b153-9f2951cff700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b0ac5d-4d73-4dd4-b153-9f2951cff700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b11ba953-c104-4b24-a257-1c9147fbe895', 'volume_name': 'volume-b11ba953-c104-4b24-a257-1c9147fbe895', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df0544c-615f-48f1-8c07-c7bec7fb190f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df0544c-615f-48f1-8c07-c7bec7fb190f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc97bbb7-9a92-46f8-bcf5-b9b14e5bf903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Volume b11ba953-c104-4b24-a257-1c9147fbe895: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b11ba953-c104-4b24-a257-1c9147fbe895', 'volume_size': 1} Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:15 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d" returned: 0 in 0.629s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d, size 1024.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-efcf5660-e10d-4c25-b3a8-0b107ec48082 {{(pid=81957) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:57:15 devstack cinder-volume[81957]: INFO cinder.image.image_utils [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Converted 1024.00 MB image at 482.77 MB/s Apr 21 20:57:15 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-efcf5660-e10d-4c25-b3a8-0b107ec48082 is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-efcf5660-e10d-4c25-b3a8-0b107ec48082 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:15 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-efcf5660-e10d-4c25-b3a8-0b107ec48082 Apr 21 20:57:15 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:15 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-efcf5660-e10d-4c25-b3a8-0b107ec48082" returned: 0 in 0.388s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-efcf5660-e10d-4c25-b3a8-0b107ec48082" released by "_copy_volume_from_snapshot" :: held 4.210s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b-efcf5660-e10d-4c25-b3a8-0b107ec48082" released by "_create_volume_from_snapshot" :: held 4.227s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.247s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.827s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1505943102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae042b10-267f-4ddc-83a4-bc40a4b4e395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e970cfed63f4e72b8d3e7877e653176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:10Z,use_quota=True,user_id='b090e29e06de4904848051c6c31fdcc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Creating volume ae042b10-267f-4ddc-83a4-bc40a4b4e395 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:15 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:57:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:15 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 1073741824 Apr 21 20:57:15 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:15 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-035be491-c02a-4275-b077-0f1fdb48868d tempest-GroupSnapshotsTest-759127538 None] Create group from source-snapshot-27c4f449-3497-4e7e-8e70-2fcf3eec9daf completed successfully. Apr 21 20:57:16 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 1073741824" returned: 0 in 0.478s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:16 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 Apr 21 20:57:16 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:16 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e005d83e-37f7-4c82-a545-81ee7c8743dd tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "cinder-quobyte-efcf5660-e10d-4c25-b3a8-0b107ec48082" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:16 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e005d83e-37f7-4c82-a545-81ee7c8743dd tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-efcf5660-e10d-4c25-b3a8-0b107ec48082" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:16 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[75066b05-89d9-41c2-b200-51cb252c3451]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e005d83e-37f7-4c82-a545-81ee7c8743dd tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-efcf5660-e10d-4c25-b3a8-0b107ec48082 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:16 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395" returned: 0 in 0.427s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:16 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c1de87ff-f43e-4863-b8c4-9d46fadd9904 tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.485s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:16 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-efcf5660-e10d-4c25-b3a8-0b107ec48082 Apr 21 20:57:16 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:16 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-c1de87ff-f43e-4863-b8c4-9d46fadd9904 tempest-VolumesSnapshotListTestJSON-1852241632 None] Creating offline snapshot f614bc2c-c6d4-4a18-8fa0-45d3628724ee of volume 1399527b-9a9f-40d4-9949-fe7514ca0e95 {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:57:16 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1d690f-6deb-4fbf-bb22-24f6515ef31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:16 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d25583cb-f481-4daa-87a1-205dd170ab62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:16 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[d758e765-ea9a-4f67-addc-96a038fe9063]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c1de87ff-f43e-4863-b8c4-9d46fadd9904 tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:16 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Volume volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 (ae042b10-267f-4ddc-83a4-bc40a4b4e395): created successfully Apr 21 20:57:16 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d25583cb-f481-4daa-87a1-205dd170ab62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:16 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Flow 'volume_create_manager' (f431d7ff-9a6a-4b86-838f-48d4e5b6d655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:16 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-69310915-1db5-4881-adcf-e29777ed56d8 tempest-VolumeDependencyTests-582766483 None] Created volume successfully. Apr 21 20:57:16 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 Apr 21 20:57:16 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:17 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e005d83e-37f7-4c82-a545-81ee7c8743dd tempest-GroupSnapshotsTest-759127538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-efcf5660-e10d-4c25-b3a8-0b107ec48082" returned: 0 in 0.454s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e005d83e-37f7-4c82-a545-81ee7c8743dd tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-efcf5660-e10d-4c25-b3a8-0b107ec48082 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:17 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-efcf5660-e10d-4c25-b3a8-0b107ec48082 Apr 21 20:57:17 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:17 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c1de87ff-f43e-4863-b8c4-9d46fadd9904 tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77" returned: 0 in 0.464s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-c1de87ff-f43e-4863-b8c4-9d46fadd9904 tempest-VolumesSnapshotListTestJSON-1852241632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1399527b-9a9f-40d4-9949-fe7514ca0e95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c1de87ff-f43e-4863-b8c4-9d46fadd9904 tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:17 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee 1G Apr 21 20:57:17 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:17 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Flow 'volume_create_manager' (da0cd42f-4dc4-4c59-a337-6a8fd504dc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47eace96-d1f7-4766-90c7-1506c12e10ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47eace96-d1f7-4766-90c7-1506c12e10ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-855268827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7574d28f-3123-41ba-a5db-3b2aab55ba78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e970cfed63f4e72b8d3e7877e653176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ae042b10-267f-4ddc-83a4-bc40a4b4e395,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:17Z,use_quota=True,user_id='b090e29e06de4904848051c6c31fdcc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ae2af1-c9c3-4dae-aade-b443f5157745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ae2af1-c9c3-4dae-aade-b443f5157745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00325bff-5131-4846-8d0b-d6f6abb9c7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e005d83e-37f7-4c82-a545-81ee7c8743dd tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-efcf5660-e10d-4c25-b3a8-0b107ec48082" returned: 0 in 0.538s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00325bff-5131-4846-8d0b-d6f6abb9c7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7574d28f-3123-41ba-a5db-3b2aab55ba78', 'volume_name': 'volume-7574d28f-3123-41ba-a5db-3b2aab55ba78', 'volume_size': 1, 'source_volid': 'ae042b10-267f-4ddc-83a4-bc40a4b4e395', 'source_volstatus': 'available'}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c9408b-1677-4372-9a33-71b3974377a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c9408b-1677-4372-9a33-71b3974377a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d051e3-9869-4cfa-9512-b8181a2bd30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:17 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Volume 7574d28f-3123-41ba-a5db-3b2aab55ba78: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7574d28f-3123-41ba-a5db-3b2aab55ba78', 'volume_size': 1, 'source_volid': 'ae042b10-267f-4ddc-83a4-bc40a4b4e395', 'source_volstatus': 'available'} Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e005d83e-37f7-4c82-a545-81ee7c8743dd tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-efcf5660-e10d-4c25-b3a8-0b107ec48082" released by "delete_volume" :: held 1.054s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-e005d83e-37f7-4c82-a545-81ee7c8743dd tempest-GroupSnapshotsTest-759127538 None] Created reservations ['fbce3033-31a4-4bac-803d-a48be9552cc8'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:17 devstack cinder-volume[81957]: WARNING cinder.quota [None req-e005d83e-37f7-4c82-a545-81ee7c8743dd tempest-GroupSnapshotsTest-759127538 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2079988053 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2079988053, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:57:17 devstack cinder-volume[81957]: WARNING cinder.quota [None req-e005d83e-37f7-4c82-a545-81ee7c8743dd tempest-GroupSnapshotsTest-759127538 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2079988053 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2079988053, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-e005d83e-37f7-4c82-a545-81ee7c8743dd tempest-GroupSnapshotsTest-759127538 None] Created reservations ['f58b070b-f84d-493d-8a4f-3cc45c9a1fa2', '9cc8582f-ce47-412d-9807-c715ae0c292b', '839e2680-775a-4887-b3cd-1fe472fb4176', 'aa9c09ad-9ad9-4c66-a185-40624fb64806'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:17 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c1de87ff-f43e-4863-b8c4-9d46fadd9904 tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee 1G" returned: 0 in 0.551s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c1de87ff-f43e-4863-b8c4-9d46fadd9904 tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:17 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee Apr 21 20:57:17 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e005d83e-37f7-4c82-a545-81ee7c8743dd tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e005d83e-37f7-4c82-a545-81ee7c8743dd tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e005d83e-37f7-4c82-a545-81ee7c8743dd tempest-GroupSnapshotsTest-759127538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e005d83e-37f7-4c82-a545-81ee7c8743dd tempest-GroupSnapshotsTest-759127538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e005d83e-37f7-4c82-a545-81ee7c8743dd tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e005d83e-37f7-4c82-a545-81ee7c8743dd tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:17 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:57:17 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:18 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c1de87ff-f43e-4863-b8c4-9d46fadd9904 tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee" returned: 0 in 0.442s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:18 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-c1de87ff-f43e-4863-b8c4-9d46fadd9904 tempest-VolumesSnapshotListTestJSON-1852241632 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee is being set with open permissions: ugo+rw Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c1de87ff-f43e-4863-b8c4-9d46fadd9904 tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:18 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee Apr 21 20:57:18 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:18 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e005d83e-37f7-4c82-a545-81ee7c8743dd tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.417s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-e005d83e-37f7-4c82-a545-81ee7c8743dd tempest-GroupSnapshotsTest-759127538 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:18 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-e005d83e-37f7-4c82-a545-81ee7c8743dd tempest-GroupSnapshotsTest-759127538 None] Delete group completed successfully. Apr 21 20:57:18 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c1de87ff-f43e-4863-b8c4-9d46fadd9904 tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee" returned: 0 in 0.407s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c1de87ff-f43e-4863-b8c4-9d46fadd9904 tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.544s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1082577581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b11ba953-c104-4b24-a257-1c9147fbe895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e12368462240d2b8a0590901c7de15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:15Z,use_quota=True,user_id='b2042c863d91495099eb4500945ba4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Creating volume b11ba953-c104-4b24-a257-1c9147fbe895 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:18 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b11ba953-c104-4b24-a257-1c9147fbe895 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:18 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b11ba953-c104-4b24-a257-1c9147fbe895 1073741824 Apr 21 20:57:18 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:18 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-c1de87ff-f43e-4863-b8c4-9d46fadd9904 tempest-VolumesSnapshotListTestJSON-1852241632 None] Create snapshot completed successfully Apr 21 20:57:18 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-10f55a58-64fa-44be-b911-cda90530c4ce tempest-GroupSnapshotsTest-759127538 None] group_snapshot 27c4f449-3497-4e7e-8e70-2fcf3eec9daf: deleting Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-10f55a58-64fa-44be-b911-cda90530c4ce tempest-GroupSnapshotsTest-759127538 None] group_snapshot 27c4f449-3497-4e7e-8e70-2fcf3eec9daf: deleting {{(pid=81957) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-10f55a58-64fa-44be-b911-cda90530c4ce tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "cinder-quobyte-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-10f55a58-64fa-44be-b911-cda90530c4ce tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-10f55a58-64fa-44be-b911-cda90530c4ce tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "cinder-quobyte-7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-10f55a58-64fa-44be-b911-cda90530c4ce tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-10f55a58-64fa-44be-b911-cda90530c4ce tempest-GroupSnapshotsTest-759127538 None] Deleting offline snapshot 7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b of volume 2776193e-0aa7-4a65-be4e-cfcb4bf9e66d {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-10f55a58-64fa-44be-b911-cda90530c4ce tempest-GroupSnapshotsTest-759127538 None] snapshot_file for this snap is: volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c9ea66-df32-4b37-a311-eeadb137f693]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-10f55a58-64fa-44be-b911-cda90530c4ce tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:18 devstack sudo[88440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b Apr 21 20:57:18 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:19 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b11ba953-c104-4b24-a257-1c9147fbe895 1073741824" returned: 0 in 0.501s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b11ba953-c104-4b24-a257-1c9147fbe895 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:19 devstack sudo[88445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b11ba953-c104-4b24-a257-1c9147fbe895 Apr 21 20:57:19 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:19 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-10f55a58-64fa-44be-b911-cda90530c4ce tempest-GroupSnapshotsTest-759127538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b" returned: 0 in 0.505s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-10f55a58-64fa-44be-b911-cda90530c4ce tempest-GroupSnapshotsTest-759127538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:19 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cde27bc-d2c8-4989-ade1-fcd829ee0da3]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-10f55a58-64fa-44be-b911-cda90530c4ce tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:19 devstack sudo[88450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d Apr 21 20:57:19 devstack sudo[88450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:19 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-83648ffe-2cbd-4ec9-87ec-2698b22ecdb5 tempest-VolumesSnapshotListTestJSON-1852241632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b11ba953-c104-4b24-a257-1c9147fbe895" returned: 0 in 0.471s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.942s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:19 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Cloning volume ae042b10-267f-4ddc-83a4-bc40a4b4e395 to volume 7574d28f-3123-41ba-a5db-3b2aab55ba78 Apr 21 20:57:19 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc97bbb7-9a92-46f8-bcf5-b9b14e5bf903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b11ba953-c104-4b24-a257-1c9147fbe895', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:19 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3fca552-b3a7-4ae3-9b86-12443b194db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:19 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Volume volume-b11ba953-c104-4b24-a257-1c9147fbe895 (b11ba953-c104-4b24-a257-1c9147fbe895): created successfully Apr 21 20:57:19 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3fca552-b3a7-4ae3-9b86-12443b194db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:19 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Flow 'volume_create_manager' (f5c6fd71-1c6d-45bf-88ec-ab9dc3279972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:19 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-3779b111-345b-416c-ba91-74b06b19d60c tempest-VolumesNegativeTest-2045745841 None] Created volume successfully. Apr 21 20:57:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Creating offline snapshot 06c659e8-675b-4713-ba7f-8301d6a2d685 of volume ae042b10-267f-4ddc-83a4-bc40a4b4e395 {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:57:19 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[a257e51e-756c-4bf5-a463-338e2c965a86]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:19 devstack sudo[88453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 Apr 21 20:57:19 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:19 devstack sudo[88450]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-10f55a58-64fa-44be-b911-cda90530c4ce tempest-GroupSnapshotsTest-759127538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d" returned: 0 in 0.489s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-10f55a58-64fa-44be-b911-cda90530c4ce tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:19 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b Apr 21 20:57:19 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:20 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395" returned: 0 in 0.483s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.06c659e8-675b-4713-ba7f-8301d6a2d685 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:20 devstack sudo[88463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.06c659e8-675b-4713-ba7f-8301d6a2d685 1G Apr 21 20:57:20 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:20 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-10f55a58-64fa-44be-b911-cda90530c4ce tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b" returned: 0 in 0.483s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-10f55a58-64fa-44be-b911-cda90530c4ce tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:20 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b Apr 21 20:57:20 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:20 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.06c659e8-675b-4713-ba7f-8301d6a2d685 1G" returned: 0 in 0.570s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.06c659e8-675b-4713-ba7f-8301d6a2d685 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:20 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.06c659e8-675b-4713-ba7f-8301d6a2d685 Apr 21 20:57:20 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:20 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-10f55a58-64fa-44be-b911-cda90530c4ce tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d.7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b" returned: 0 in 0.479s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:20 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-10f55a58-64fa-44be-b911-cda90530c4ce tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-7ed893c3-5a0e-4ec4-8c17-48ce3b1e8f3b" released by "_delete_snapshot" :: held 2.012s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:20 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-10f55a58-64fa-44be-b911-cda90530c4ce tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d" released by "delete_snapshot" :: held 2.025s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:20 devstack cinder-volume[81957]: WARNING cinder.quota [None req-10f55a58-64fa-44be-b911-cda90530c4ce tempest-GroupSnapshotsTest-759127538 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2079988053 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2079988053, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:57:20 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-10f55a58-64fa-44be-b911-cda90530c4ce tempest-GroupSnapshotsTest-759127538 None] Created reservations ['8667d270-e52c-4650-92a6-2e82112c1fb7', '4745fd64-d44e-4752-ad4b-76e0a4af8a55', '5b24c5e0-af45-48b9-81ff-4a6641d0cec1', '971fa855-b33e-4641-913b-eda7b6822f32'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:20 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-10f55a58-64fa-44be-b911-cda90530c4ce tempest-GroupSnapshotsTest-759127538 None] group_snapshot 27c4f449-3497-4e7e-8e70-2fcf3eec9daf: deleted successfully Apr 21 20:57:21 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.06c659e8-675b-4713-ba7f-8301d6a2d685" returned: 0 in 0.516s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:21 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.06c659e8-675b-4713-ba7f-8301d6a2d685 is being set with open permissions: ugo+rw Apr 21 20:57:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.06c659e8-675b-4713-ba7f-8301d6a2d685 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:21 devstack sudo[88483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.06c659e8-675b-4713-ba7f-8301d6a2d685 Apr 21 20:57:21 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:21 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.06c659e8-675b-4713-ba7f-8301d6a2d685" returned: 0 in 0.415s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:21 devstack sudo[88486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.info Apr 21 20:57:21 devstack sudo[88486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:22 devstack sudo[88486]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.info" returned: 0 in 0.481s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:22 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.info is being set with open permissions: ugo+rw Apr 21 20:57:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:22 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-015f6ccf-858d-49cf-8c8e-952c5e4655e4 tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "cinder-quobyte-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:22 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.info Apr 21 20:57:22 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:22 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-015f6ccf-858d-49cf-8c8e-952c5e4655e4 tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:22 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[91af2f73-649d-4a0c-862d-d1eda0300101]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-015f6ccf-858d-49cf-8c8e-952c5e4655e4 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:22 devstack sudo[88491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d Apr 21 20:57:22 devstack sudo[88491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:22 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.info" returned: 0 in 0.423s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:22 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Acquiring lock "cinder-quobyte-7574d28f-3123-41ba-a5db-3b2aab55ba78" by "_copy_volume_from_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:22 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Lock "cinder-quobyte-7574d28f-3123-41ba-a5db-3b2aab55ba78" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:22 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] snapshot: 06c659e8-675b-4713-ba7f-8301d6a2d685, volume: 7574d28f-3123-41ba-a5db-3b2aab55ba78, {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:57:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:22 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:22 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:22 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c2c8c1-cc41-4fd0-a184-c72d4e01ad1d]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.06c659e8-675b-4713-ba7f-8301d6a2d685 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:22 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.06c659e8-675b-4713-ba7f-8301d6a2d685 Apr 21 20:57:22 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:22 devstack sudo[88491]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-015f6ccf-858d-49cf-8c8e-952c5e4655e4 tempest-GroupSnapshotsTest-759127538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d" returned: 0 in 0.502s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-015f6ccf-858d-49cf-8c8e-952c5e4655e4 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:22 devstack sudo[88499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d Apr 21 20:57:22 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:23 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.06c659e8-675b-4713-ba7f-8301d6a2d685" returned: 0 in 0.503s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:23 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:23 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:57:23 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Creating direct copy from snapshot {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:57:23 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61bc5d0-1233-422c-bb89-bedb32079252]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:23 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-015f6ccf-858d-49cf-8c8e-952c5e4655e4 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d" returned: 0 in 0.427s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:23 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-015f6ccf-858d-49cf-8c8e-952c5e4655e4 tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-2776193e-0aa7-4a65-be4e-cfcb4bf9e66d" released by "delete_volume" :: held 0.972s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:23 devstack sudo[88505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 Apr 21 20:57:23 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:23 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-015f6ccf-858d-49cf-8c8e-952c5e4655e4 tempest-GroupSnapshotsTest-759127538 None] Created reservations ['4cb2fb51-66c4-4017-89c8-69525ce258e6'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:23 devstack cinder-volume[81957]: WARNING cinder.db.sqlalchemy.api [None req-015f6ccf-858d-49cf-8c8e-952c5e4655e4 tempest-GroupSnapshotsTest-759127538 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2079988053'] Apr 21 20:57:23 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-015f6ccf-858d-49cf-8c8e-952c5e4655e4 tempest-GroupSnapshotsTest-759127538 None] Created reservations ['8ba1e182-f1d9-4b59-b949-183c7e199534', '299d53d0-dd1c-43be-a973-c59cd425553d', 'd628c3ed-27f7-4d20-acf8-52e29dc25d59', '45bf9e27-b759-42b5-bbe1-92a599d9bf7f'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-015f6ccf-858d-49cf-8c8e-952c5e4655e4 tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-015f6ccf-858d-49cf-8c8e-952c5e4655e4 tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:23 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-015f6ccf-858d-49cf-8c8e-952c5e4655e4 tempest-GroupSnapshotsTest-759127538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:23 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-015f6ccf-858d-49cf-8c8e-952c5e4655e4 tempest-GroupSnapshotsTest-759127538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-015f6ccf-858d-49cf-8c8e-952c5e4655e4 tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-015f6ccf-858d-49cf-8c8e-952c5e4655e4 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:23 devstack sudo[88507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:57:23 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:23 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395" returned: 0 in 0.479s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:23 devstack cinder-volume[81957]: DEBUG cinder.utils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Path /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7574d28f-3123-41ba-a5db-3b2aab55ba78 not found in is_blk_device check {{(pid=81957) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:57:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7574d28f-3123-41ba-a5db-3b2aab55ba78 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:23 devstack sudo[88512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7574d28f-3123-41ba-a5db-3b2aab55ba78 Apr 21 20:57:23 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:23 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-015f6ccf-858d-49cf-8c8e-952c5e4655e4 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.418s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:23 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-015f6ccf-858d-49cf-8c8e-952c5e4655e4 tempest-GroupSnapshotsTest-759127538 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:23 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-015f6ccf-858d-49cf-8c8e-952c5e4655e4 tempest-GroupSnapshotsTest-759127538 None] Delete group completed successfully. Apr 21 20:57:25 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-e8dd664e-e2c6-4325-a5ff-f16106fadfe4 tempest-GroupSnapshotsTest-759127538 None] Group tempest-GroupSnapshotsTest-Group-267031077: creating Apr 21 20:57:25 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-e8dd664e-e2c6-4325-a5ff-f16106fadfe4 tempest-GroupSnapshotsTest-759127538 None] Group tempest-GroupSnapshotsTest-Group-267031077: created successfully Apr 21 20:57:25 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-e8dd664e-e2c6-4325-a5ff-f16106fadfe4 tempest-GroupSnapshotsTest-759127538 None] Create group completed successfully. Apr 21 20:57:25 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7574d28f-3123-41ba-a5db-3b2aab55ba78" returned: 0 in 2.108s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:25 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a63bc3d-079d-4e05-864b-abd918fb7300]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:25 devstack sudo[88528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 Apr 21 20:57:25 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:26 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Flow 'volume_create_manager' (2bc7768b-7bd6-4c54-b298-8321d99d64ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f94bb8-ffe9-4d7a-93fa-a079acf4b166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f94bb8-ffe9-4d7a-93fa-a079acf4b166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1061627936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=64a32918-d99f-4633-aa86-059f3b44748e,host='devstack@QuobyteHD#QuobyteHD',id=0e31c706-401d-4e6f-a71a-d31be2ac60fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92d06595be084c358cb2dcbbb6d9916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:26Z,use_quota=True,user_id='c095ce2da4ad4d169b5e9613d5cd56d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a5753c0-b7e5-4b4c-9668-ea6e82463bb1),volume_type_id=1a5753c0-b7e5-4b4c-9668-ea6e82463bb1)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f4fdf6c-fa55-4491-ae32-1e52bcdcc27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f4fdf6c-fa55-4491-ae32-1e52bcdcc27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51420b7-948f-43a5-bcc6-50fa76f483c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51420b7-948f-43a5-bcc6-50fa76f483c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e31c706-401d-4e6f-a71a-d31be2ac60fe', 'volume_name': 'volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (227b1044-1c9b-4a22-b2d3-d76bbfb13cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (227b1044-1c9b-4a22-b2d3-d76bbfb13cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5846c5-8d5c-4025-9fd2-629c2e778763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:26 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Volume 0e31c706-401d-4e6f-a71a-d31be2ac60fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe', 'volume_size': 1} Apr 21 20:57:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:26 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395" returned: 0 in 0.705s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:26 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395, size 1024.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7574d28f-3123-41ba-a5db-3b2aab55ba78 {{(pid=81957) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:57:26 devstack cinder-volume[81957]: INFO cinder.image.image_utils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Converted 1024.00 MB image at 485.48 MB/s Apr 21 20:57:26 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7574d28f-3123-41ba-a5db-3b2aab55ba78 is being set with open permissions: ugo+rw Apr 21 20:57:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7574d28f-3123-41ba-a5db-3b2aab55ba78 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:26 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7574d28f-3123-41ba-a5db-3b2aab55ba78 Apr 21 20:57:26 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:26 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7574d28f-3123-41ba-a5db-3b2aab55ba78" returned: 0 in 0.466s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:26 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Lock "cinder-quobyte-7574d28f-3123-41ba-a5db-3b2aab55ba78" released by "_copy_volume_from_snapshot" :: held 4.304s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:26 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Acquiring lock "cinder-quobyte-06c659e8-675b-4713-ba7f-8301d6a2d685" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:26 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Lock "cinder-quobyte-06c659e8-675b-4713-ba7f-8301d6a2d685" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:26 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Deleting offline snapshot 06c659e8-675b-4713-ba7f-8301d6a2d685 of volume ae042b10-267f-4ddc-83a4-bc40a4b4e395 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:57:26 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] snapshot_file for this snap is: volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.06c659e8-675b-4713-ba7f-8301d6a2d685 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:57:26 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0cf624-74da-4608-affd-7248bd731bc0]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.06c659e8-675b-4713-ba7f-8301d6a2d685 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:27 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.06c659e8-675b-4713-ba7f-8301d6a2d685 Apr 21 20:57:27 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:27 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.06c659e8-675b-4713-ba7f-8301d6a2d685" returned: 0 in 0.520s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:27 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:27 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[73184a18-d917-4afb-b62f-bc66a06d5a92]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:27 devstack sudo[88557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 Apr 21 20:57:27 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:27 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395" returned: 0 in 0.485s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.06c659e8-675b-4713-ba7f-8301d6a2d685 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:27 devstack sudo[88562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.06c659e8-675b-4713-ba7f-8301d6a2d685 Apr 21 20:57:27 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:28 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.06c659e8-675b-4713-ba7f-8301d6a2d685" returned: 0 in 0.492s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.06c659e8-675b-4713-ba7f-8301d6a2d685 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:28 devstack sudo[88567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.06c659e8-675b-4713-ba7f-8301d6a2d685 Apr 21 20:57:28 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:28 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395.06c659e8-675b-4713-ba7f-8301d6a2d685" returned: 0 in 0.396s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:28 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Lock "cinder-quobyte-06c659e8-675b-4713-ba7f-8301d6a2d685" released by "_delete_snapshot" :: held 1.948s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.297s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-83648ffe-2cbd-4ec9-87ec-2698b22ecdb5 tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.307s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:28 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-83648ffe-2cbd-4ec9-87ec-2698b22ecdb5 tempest-VolumesSnapshotListTestJSON-1852241632 None] Creating offline snapshot 2ac2f84e-e991-4571-816a-fac0c8300999 of volume 1399527b-9a9f-40d4-9949-fe7514ca0e95 {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:57:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d051e3-9869-4cfa-9512-b8181a2bd30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7574d28f-3123-41ba-a5db-3b2aab55ba78', 'volume_size': 1, 'source_volid': 'ae042b10-267f-4ddc-83a4-bc40a4b4e395', 'source_volstatus': 'available'}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1442a899-12c7-41ca-b4cf-e02719a7db5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:28 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9f7f9c-8204-4ea9-8ec5-07c25031763a]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-83648ffe-2cbd-4ec9-87ec-2698b22ecdb5 tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:28 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Volume volume-7574d28f-3123-41ba-a5db-3b2aab55ba78 (7574d28f-3123-41ba-a5db-3b2aab55ba78): created successfully Apr 21 20:57:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1442a899-12c7-41ca-b4cf-e02719a7db5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:28 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Flow 'volume_create_manager' (da0cd42f-4dc4-4c59-a337-6a8fd504dc84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:28 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-90cdbaa2-6392-4fb3-a6d1-2b427d8e5c9b tempest-VolumeDependencyTests-582766483 None] Created volume successfully. Apr 21 20:57:28 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee Apr 21 20:57:28 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:29 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1530ca89-e712-4aa4-91e4-7ce96757f27f tempest-VolumeDependencyTests-582766483 None] Acquiring lock "cinder-ae042b10-267f-4ddc-83a4-bc40a4b4e395-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:29 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1530ca89-e712-4aa4-91e4-7ce96757f27f tempest-VolumeDependencyTests-582766483 None] Lock "cinder-ae042b10-267f-4ddc-83a4-bc40a4b4e395-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:29 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1530ca89-e712-4aa4-91e4-7ce96757f27f tempest-VolumeDependencyTests-582766483 None] Acquiring lock "cinder-quobyte-ae042b10-267f-4ddc-83a4-bc40a4b4e395" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:29 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1530ca89-e712-4aa4-91e4-7ce96757f27f tempest-VolumeDependencyTests-582766483 None] Lock "cinder-quobyte-ae042b10-267f-4ddc-83a4-bc40a4b4e395" acquired by "delete_volume" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:29 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[42db7760-3963-4be9-be2e-2485e0c27010]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1530ca89-e712-4aa4-91e4-7ce96757f27f tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:29 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 Apr 21 20:57:29 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:29 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-83648ffe-2cbd-4ec9-87ec-2698b22ecdb5 tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee" returned: 0 in 0.533s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-83648ffe-2cbd-4ec9-87ec-2698b22ecdb5 tempest-VolumesSnapshotListTestJSON-1852241632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1399527b-9a9f-40d4-9949-fe7514ca0e95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-83648ffe-2cbd-4ec9-87ec-2698b22ecdb5 tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.2ac2f84e-e991-4571-816a-fac0c8300999 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:29 devstack sudo[88578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.2ac2f84e-e991-4571-816a-fac0c8300999 1G Apr 21 20:57:29 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:29 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1530ca89-e712-4aa4-91e4-7ce96757f27f tempest-VolumeDependencyTests-582766483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395" returned: 0 in 0.518s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1530ca89-e712-4aa4-91e4-7ce96757f27f tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:29 devstack sudo[88585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395 Apr 21 20:57:29 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:29 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-83648ffe-2cbd-4ec9-87ec-2698b22ecdb5 tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.2ac2f84e-e991-4571-816a-fac0c8300999 1G" returned: 0 in 0.522s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-83648ffe-2cbd-4ec9-87ec-2698b22ecdb5 tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.2ac2f84e-e991-4571-816a-fac0c8300999 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:29 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.2ac2f84e-e991-4571-816a-fac0c8300999 Apr 21 20:57:30 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:30 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1530ca89-e712-4aa4-91e4-7ce96757f27f tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ae042b10-267f-4ddc-83a4-bc40a4b4e395" returned: 0 in 0.456s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1530ca89-e712-4aa4-91e4-7ce96757f27f tempest-VolumeDependencyTests-582766483 None] Lock "cinder-quobyte-ae042b10-267f-4ddc-83a4-bc40a4b4e395" released by "delete_volume" :: held 1.016s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-1530ca89-e712-4aa4-91e4-7ce96757f27f tempest-VolumeDependencyTests-582766483 None] Created reservations ['c6fd9a6b-85e7-49e8-8d22-d5dbc71f2d61', 'ab79c81b-e875-4220-aa87-88b0ee42ea05', 'a38327b7-d3b7-40a9-8f65-a3535bde9454', '421cb585-e996-4e5f-b64e-40085919dc74'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1530ca89-e712-4aa4-91e4-7ce96757f27f tempest-VolumeDependencyTests-582766483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1530ca89-e712-4aa4-91e4-7ce96757f27f tempest-VolumeDependencyTests-582766483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-1530ca89-e712-4aa4-91e4-7ce96757f27f tempest-VolumeDependencyTests-582766483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-1530ca89-e712-4aa4-91e4-7ce96757f27f tempest-VolumeDependencyTests-582766483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1530ca89-e712-4aa4-91e4-7ce96757f27f tempest-VolumeDependencyTests-582766483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1530ca89-e712-4aa4-91e4-7ce96757f27f tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:30 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:57:30 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:30 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-83648ffe-2cbd-4ec9-87ec-2698b22ecdb5 tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.2ac2f84e-e991-4571-816a-fac0c8300999" returned: 0 in 0.544s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:30 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-83648ffe-2cbd-4ec9-87ec-2698b22ecdb5 tempest-VolumesSnapshotListTestJSON-1852241632 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.2ac2f84e-e991-4571-816a-fac0c8300999 is being set with open permissions: ugo+rw Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-83648ffe-2cbd-4ec9-87ec-2698b22ecdb5 tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.2ac2f84e-e991-4571-816a-fac0c8300999 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:30 devstack sudo[88599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.2ac2f84e-e991-4571-816a-fac0c8300999 Apr 21 20:57:30 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:30 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1530ca89-e712-4aa4-91e4-7ce96757f27f tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.447s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-1530ca89-e712-4aa4-91e4-7ce96757f27f tempest-VolumeDependencyTests-582766483 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:30 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-1530ca89-e712-4aa4-91e4-7ce96757f27f tempest-VolumeDependencyTests-582766483 None] Deleted volume successfully. Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1530ca89-e712-4aa4-91e4-7ce96757f27f tempest-VolumeDependencyTests-582766483 None] Lock "cinder-ae042b10-267f-4ddc-83a4-bc40a4b4e395-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:30 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-83648ffe-2cbd-4ec9-87ec-2698b22ecdb5 tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.2ac2f84e-e991-4571-816a-fac0c8300999" returned: 0 in 0.432s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-83648ffe-2cbd-4ec9-87ec-2698b22ecdb5 tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.697s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=64a32918-d99f-4633-aa86-059f3b44748e,created_at=2026-04-21T18:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1061627936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=64a32918-d99f-4633-aa86-059f3b44748e,host='devstack@QuobyteHD#QuobyteHD',id=0e31c706-401d-4e6f-a71a-d31be2ac60fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92d06595be084c358cb2dcbbb6d9916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:26Z,use_quota=True,user_id='c095ce2da4ad4d169b5e9613d5cd56d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a5753c0-b7e5-4b4c-9668-ea6e82463bb1),volume_type_id=1a5753c0-b7e5-4b4c-9668-ea6e82463bb1)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Creating volume 0e31c706-401d-4e6f-a71a-d31be2ac60fe {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:30 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:57:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:30 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe 1073741824 Apr 21 20:57:30 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:31 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-83648ffe-2cbd-4ec9-87ec-2698b22ecdb5 tempest-VolumesSnapshotListTestJSON-1852241632 None] Create snapshot completed successfully Apr 21 20:57:31 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9cf1b717-3cbd-4db0-8d13-a032cf553766 tempest-VolumeDependencyTests-582766483 None] Acquiring lock "cinder-7574d28f-3123-41ba-a5db-3b2aab55ba78-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:31 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9cf1b717-3cbd-4db0-8d13-a032cf553766 tempest-VolumeDependencyTests-582766483 None] Lock "cinder-7574d28f-3123-41ba-a5db-3b2aab55ba78-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:31 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9cf1b717-3cbd-4db0-8d13-a032cf553766 tempest-VolumeDependencyTests-582766483 None] Acquiring lock "cinder-quobyte-7574d28f-3123-41ba-a5db-3b2aab55ba78" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:31 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9cf1b717-3cbd-4db0-8d13-a032cf553766 tempest-VolumeDependencyTests-582766483 None] Lock "cinder-quobyte-7574d28f-3123-41ba-a5db-3b2aab55ba78" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:31 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89198cd-f93c-4d17-bd53-be7fcf998778]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9cf1b717-3cbd-4db0-8d13-a032cf553766 tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7574d28f-3123-41ba-a5db-3b2aab55ba78 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:31 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe 1073741824" returned: 0 in 0.601s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:31 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7574d28f-3123-41ba-a5db-3b2aab55ba78 Apr 21 20:57:31 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:31 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe Apr 21 20:57:31 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:32 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe" returned: 0 in 0.545s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5846c5-8d5c-4025-9fd2-629c2e778763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:32 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04392b4e-bf50-49a9-babd-a59e8ece3171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9cf1b717-3cbd-4db0-8d13-a032cf553766 tempest-VolumeDependencyTests-582766483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7574d28f-3123-41ba-a5db-3b2aab55ba78" returned: 0 in 0.667s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9cf1b717-3cbd-4db0-8d13-a032cf553766 tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7574d28f-3123-41ba-a5db-3b2aab55ba78 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:32 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Volume volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe (0e31c706-401d-4e6f-a71a-d31be2ac60fe): created successfully Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04392b4e-bf50-49a9-babd-a59e8ece3171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Flow 'volume_create_manager' (2bc7768b-7bd6-4c54-b298-8321d99d64ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:32 devstack sudo[88642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7574d28f-3123-41ba-a5db-3b2aab55ba78 Apr 21 20:57:32 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:32 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-32248c47-6435-4f51-b54a-0d0fe42604f1 tempest-GroupSnapshotsTest-759127538 None] Created volume successfully. Apr 21 20:57:32 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9cf1b717-3cbd-4db0-8d13-a032cf553766 tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-7574d28f-3123-41ba-a5db-3b2aab55ba78" returned: 0 in 0.531s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9cf1b717-3cbd-4db0-8d13-a032cf553766 tempest-VolumeDependencyTests-582766483 None] Lock "cinder-quobyte-7574d28f-3123-41ba-a5db-3b2aab55ba78" released by "delete_volume" :: held 1.243s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-9cf1b717-3cbd-4db0-8d13-a032cf553766 tempest-VolumeDependencyTests-582766483 None] Created reservations ['61a8e79a-ff29-4a90-a474-741a2cc9aee3', '860ce031-d7aa-465b-96e9-ce14788d25d5', 'a2ede5c2-7c37-42b9-8c30-011d0a892b74', '36c5ec6a-42bb-43b5-8103-898da65bc7f7'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9cf1b717-3cbd-4db0-8d13-a032cf553766 tempest-VolumeDependencyTests-582766483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9cf1b717-3cbd-4db0-8d13-a032cf553766 tempest-VolumeDependencyTests-582766483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9cf1b717-3cbd-4db0-8d13-a032cf553766 tempest-VolumeDependencyTests-582766483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9cf1b717-3cbd-4db0-8d13-a032cf553766 tempest-VolumeDependencyTests-582766483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9cf1b717-3cbd-4db0-8d13-a032cf553766 tempest-VolumeDependencyTests-582766483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9cf1b717-3cbd-4db0-8d13-a032cf553766 tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9e8344d4-4992-47b7-bd1f-e2127582e763 tempest-VolumesSnapshotListTestJSON-1852241632 None] Acquiring lock "cinder-2ac2f84e-e991-4571-816a-fac0c8300999-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:32 devstack sudo[88647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:57:32 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9e8344d4-4992-47b7-bd1f-e2127582e763 tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "cinder-2ac2f84e-e991-4571-816a-fac0c8300999-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9e8344d4-4992-47b7-bd1f-e2127582e763 tempest-VolumesSnapshotListTestJSON-1852241632 None] Acquiring lock "cinder-quobyte-1399527b-9a9f-40d4-9949-fe7514ca0e95" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9e8344d4-4992-47b7-bd1f-e2127582e763 tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "cinder-quobyte-1399527b-9a9f-40d4-9949-fe7514ca0e95" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9e8344d4-4992-47b7-bd1f-e2127582e763 tempest-VolumesSnapshotListTestJSON-1852241632 None] Acquiring lock "cinder-quobyte-2ac2f84e-e991-4571-816a-fac0c8300999" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9e8344d4-4992-47b7-bd1f-e2127582e763 tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "cinder-quobyte-2ac2f84e-e991-4571-816a-fac0c8300999" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-9e8344d4-4992-47b7-bd1f-e2127582e763 tempest-VolumesSnapshotListTestJSON-1852241632 None] Deleting offline snapshot 2ac2f84e-e991-4571-816a-fac0c8300999 of volume 1399527b-9a9f-40d4-9949-fe7514ca0e95 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-9e8344d4-4992-47b7-bd1f-e2127582e763 tempest-VolumesSnapshotListTestJSON-1852241632 None] snapshot_file for this snap is: volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.2ac2f84e-e991-4571-816a-fac0c8300999 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[09abc7c1-8810-4788-80d1-e57132e3f9e3]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9e8344d4-4992-47b7-bd1f-e2127582e763 tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.2ac2f84e-e991-4571-816a-fac0c8300999 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Flow 'volume_create_manager' (401cd3cb-1516-4f56-8b9d-946b1c7184b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f720c81-1bc4-47b3-b4a0-76b10f3819ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:33 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.2ac2f84e-e991-4571-816a-fac0c8300999 Apr 21 20:57:33 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f720c81-1bc4-47b3-b4a0-76b10f3819ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1137156371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=64a32918-d99f-4633-aa86-059f3b44748e,host='devstack@QuobyteHD#QuobyteHD',id=4cf5fb47-7895-4421-b90e-26a61e5ecf71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92d06595be084c358cb2dcbbb6d9916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:33Z,use_quota=True,user_id='c095ce2da4ad4d169b5e9613d5cd56d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a5753c0-b7e5-4b4c-9668-ea6e82463bb1),volume_type_id=1a5753c0-b7e5-4b4c-9668-ea6e82463bb1)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ffda4ac-b1ed-4566-a4a3-5041d785ba0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ffda4ac-b1ed-4566-a4a3-5041d785ba0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170350c3-788a-4e45-8766-3facca0da39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170350c3-788a-4e45-8766-3facca0da39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cf5fb47-7895-4421-b90e-26a61e5ecf71', 'volume_name': 'volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ec7a3c-4d15-405d-ac9d-d7dc902592b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ec7a3c-4d15-405d-ac9d-d7dc902592b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (370314ee-07ea-45b0-9bf1-44bc7e5c6c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:33 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Volume 4cf5fb47-7895-4421-b90e-26a61e5ecf71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71', 'volume_size': 1} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=64a32918-d99f-4633-aa86-059f3b44748e,created_at=2026-04-21T18:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1137156371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=64a32918-d99f-4633-aa86-059f3b44748e,host='devstack@QuobyteHD#QuobyteHD',id=4cf5fb47-7895-4421-b90e-26a61e5ecf71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92d06595be084c358cb2dcbbb6d9916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:33Z,use_quota=True,user_id='c095ce2da4ad4d169b5e9613d5cd56d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a5753c0-b7e5-4b4c-9668-ea6e82463bb1),volume_type_id=1a5753c0-b7e5-4b4c-9668-ea6e82463bb1)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Creating volume 4cf5fb47-7895-4421-b90e-26a61e5ecf71 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:33 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:33 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71 1073741824 Apr 21 20:57:33 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:33 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9cf1b717-3cbd-4db0-8d13-a032cf553766 tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.613s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-9cf1b717-3cbd-4db0-8d13-a032cf553766 tempest-VolumeDependencyTests-582766483 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:33 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-9cf1b717-3cbd-4db0-8d13-a032cf553766 tempest-VolumeDependencyTests-582766483 None] Deleted volume successfully. Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9cf1b717-3cbd-4db0-8d13-a032cf553766 tempest-VolumeDependencyTests-582766483 None] Lock "cinder-7574d28f-3123-41ba-a5db-3b2aab55ba78-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:33 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9e8344d4-4992-47b7-bd1f-e2127582e763 tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.2ac2f84e-e991-4571-816a-fac0c8300999" returned: 0 in 0.594s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-9e8344d4-4992-47b7-bd1f-e2127582e763 tempest-VolumesSnapshotListTestJSON-1852241632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1399527b-9a9f-40d4-9949-fe7514ca0e95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c0f76d-8c5a-47e6-b746-8548075496c3]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9e8344d4-4992-47b7-bd1f-e2127582e763 tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:33 devstack sudo[88657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee Apr 21 20:57:33 devstack sudo[88657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f193ceb9-8acc-4207-8e8a-5cf55f496c82 tempest-VolumeDependencyTests-582766483 None] Acquiring lock "cinder-8ab0ac2c-b2a7-4365-a0a0-aeba23337518-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f193ceb9-8acc-4207-8e8a-5cf55f496c82 tempest-VolumeDependencyTests-582766483 None] Lock "cinder-8ab0ac2c-b2a7-4365-a0a0-aeba23337518-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f193ceb9-8acc-4207-8e8a-5cf55f496c82 tempest-VolumeDependencyTests-582766483 None] Acquiring lock "cinder-quobyte-8ab0ac2c-b2a7-4365-a0a0-aeba23337518" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f193ceb9-8acc-4207-8e8a-5cf55f496c82 tempest-VolumeDependencyTests-582766483 None] Lock "cinder-quobyte-8ab0ac2c-b2a7-4365-a0a0-aeba23337518" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[88048c59-13cd-4f56-ae30-fd20d50fd02d]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f193ceb9-8acc-4207-8e8a-5cf55f496c82 tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8ab0ac2c-b2a7-4365-a0a0-aeba23337518 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:33 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71 1073741824" returned: 0 in 0.678s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:33 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8ab0ac2c-b2a7-4365-a0a0-aeba23337518 Apr 21 20:57:33 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:33 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71 Apr 21 20:57:33 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:34 devstack sudo[88657]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9e8344d4-4992-47b7-bd1f-e2127582e763 tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee" returned: 0 in 0.749s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:34 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-9e8344d4-4992-47b7-bd1f-e2127582e763 tempest-VolumesSnapshotListTestJSON-1852241632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1399527b-9a9f-40d4-9949-fe7514ca0e95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9e8344d4-4992-47b7-bd1f-e2127582e763 tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.2ac2f84e-e991-4571-816a-fac0c8300999 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:34 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.2ac2f84e-e991-4571-816a-fac0c8300999 Apr 21 20:57:34 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:34 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71" returned: 0 in 0.673s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:34 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:34 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f193ceb9-8acc-4207-8e8a-5cf55f496c82 tempest-VolumeDependencyTests-582766483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8ab0ac2c-b2a7-4365-a0a0-aeba23337518" returned: 0 in 0.777s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f193ceb9-8acc-4207-8e8a-5cf55f496c82 tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8ab0ac2c-b2a7-4365-a0a0-aeba23337518 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:34 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8ab0ac2c-b2a7-4365-a0a0-aeba23337518 Apr 21 20:57:34 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:34 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (370314ee-07ea-45b0-9bf1-44bc7e5c6c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:34 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73dc882c-1c69-41d2-8857-548fd64b931a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:34 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Volume volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71 (4cf5fb47-7895-4421-b90e-26a61e5ecf71): created successfully Apr 21 20:57:34 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73dc882c-1c69-41d2-8857-548fd64b931a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:34 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Flow 'volume_create_manager' (401cd3cb-1516-4f56-8b9d-946b1c7184b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:34 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-78ee43e9-05ec-40af-a27d-8f7cdf050162 tempest-GroupSnapshotsTest-759127538 None] Created volume successfully. Apr 21 20:57:35 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9e8344d4-4992-47b7-bd1f-e2127582e763 tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.2ac2f84e-e991-4571-816a-fac0c8300999" returned: 0 in 0.692s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9e8344d4-4992-47b7-bd1f-e2127582e763 tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.2ac2f84e-e991-4571-816a-fac0c8300999 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:35 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.2ac2f84e-e991-4571-816a-fac0c8300999 Apr 21 20:57:35 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:35 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f193ceb9-8acc-4207-8e8a-5cf55f496c82 tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8ab0ac2c-b2a7-4365-a0a0-aeba23337518" returned: 0 in 0.522s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:35 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f193ceb9-8acc-4207-8e8a-5cf55f496c82 tempest-VolumeDependencyTests-582766483 None] Lock "cinder-quobyte-8ab0ac2c-b2a7-4365-a0a0-aeba23337518" released by "delete_volume" :: held 1.322s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:35 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-f193ceb9-8acc-4207-8e8a-5cf55f496c82 tempest-VolumeDependencyTests-582766483 None] Created reservations ['6291d3b5-cd6d-4039-a31b-772582090aef', 'eaf576da-7543-4937-805b-bcd43c743385', 'f8e0b925-fc41-4c7b-9b58-ab170797c046', 'b4786a9d-1fab-4565-8734-82c7b0db0ffb'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f193ceb9-8acc-4207-8e8a-5cf55f496c82 tempest-VolumeDependencyTests-582766483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f193ceb9-8acc-4207-8e8a-5cf55f496c82 tempest-VolumeDependencyTests-582766483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:35 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f193ceb9-8acc-4207-8e8a-5cf55f496c82 tempest-VolumeDependencyTests-582766483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:35 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f193ceb9-8acc-4207-8e8a-5cf55f496c82 tempest-VolumeDependencyTests-582766483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f193ceb9-8acc-4207-8e8a-5cf55f496c82 tempest-VolumeDependencyTests-582766483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f193ceb9-8acc-4207-8e8a-5cf55f496c82 tempest-VolumeDependencyTests-582766483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:35 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:57:35 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:35 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-74273bbf-77cb-4c04-9a8c-6d42c805ada7 tempest-GroupSnapshotsTest-759127538 None] Update group completed successfully. Apr 21 20:57:35 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9e8344d4-4992-47b7-bd1f-e2127582e763 tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.2ac2f84e-e991-4571-816a-fac0c8300999" returned: 0 in 0.446s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:35 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9e8344d4-4992-47b7-bd1f-e2127582e763 tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "cinder-quobyte-2ac2f84e-e991-4571-816a-fac0c8300999" released by "_delete_snapshot" :: held 2.549s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:35 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9e8344d4-4992-47b7-bd1f-e2127582e763 tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "cinder-quobyte-1399527b-9a9f-40d4-9949-fe7514ca0e95" released by "delete_snapshot" :: held 2.580s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:35 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-9e8344d4-4992-47b7-bd1f-e2127582e763 tempest-VolumesSnapshotListTestJSON-1852241632 None] Created reservations ['66296283-5e4b-4236-ae1d-dda2af3d9b30', '478c6e39-0360-420c-8b8b-1f4e5c73e077', '59d7bc3d-97b0-4bcc-839f-4ac660fd5174', '48343047-599b-484f-8f4d-ae1d7559bd05'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:35 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-9e8344d4-4992-47b7-bd1f-e2127582e763 tempest-VolumesSnapshotListTestJSON-1852241632 None] Delete snapshot completed successfully. Apr 21 20:57:35 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-9e8344d4-4992-47b7-bd1f-e2127582e763 tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "cinder-2ac2f84e-e991-4571-816a-fac0c8300999-delete_snapshot" released by "delete_snapshot" :: held 2.700s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:35 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f193ceb9-8acc-4207-8e8a-5cf55f496c82 tempest-VolumeDependencyTests-582766483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.623s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:35 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-f193ceb9-8acc-4207-8e8a-5cf55f496c82 tempest-VolumeDependencyTests-582766483 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:35 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-f193ceb9-8acc-4207-8e8a-5cf55f496c82 tempest-VolumeDependencyTests-582766483 None] Deleted volume successfully. Apr 21 20:57:35 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f193ceb9-8acc-4207-8e8a-5cf55f496c82 tempest-VolumeDependencyTests-582766483 None] Lock "cinder-8ab0ac2c-b2a7-4365-a0a0-aeba23337518-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:36 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-67f3af8d-304d-42e0-93b5-c28c953006be tempest-VolumesSnapshotListTestJSON-1852241632 None] Acquiring lock "cinder-f614bc2c-c6d4-4a18-8fa0-45d3628724ee-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:36 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-67f3af8d-304d-42e0-93b5-c28c953006be tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "cinder-f614bc2c-c6d4-4a18-8fa0-45d3628724ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:36 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-67f3af8d-304d-42e0-93b5-c28c953006be tempest-VolumesSnapshotListTestJSON-1852241632 None] Acquiring lock "cinder-quobyte-1399527b-9a9f-40d4-9949-fe7514ca0e95" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:36 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-67f3af8d-304d-42e0-93b5-c28c953006be tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "cinder-quobyte-1399527b-9a9f-40d4-9949-fe7514ca0e95" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:36 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-67f3af8d-304d-42e0-93b5-c28c953006be tempest-VolumesSnapshotListTestJSON-1852241632 None] Acquiring lock "cinder-quobyte-f614bc2c-c6d4-4a18-8fa0-45d3628724ee" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:36 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-67f3af8d-304d-42e0-93b5-c28c953006be tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "cinder-quobyte-f614bc2c-c6d4-4a18-8fa0-45d3628724ee" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:36 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-67f3af8d-304d-42e0-93b5-c28c953006be tempest-VolumesSnapshotListTestJSON-1852241632 None] Deleting offline snapshot f614bc2c-c6d4-4a18-8fa0-45d3628724ee of volume 1399527b-9a9f-40d4-9949-fe7514ca0e95 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:57:36 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-67f3af8d-304d-42e0-93b5-c28c953006be tempest-VolumesSnapshotListTestJSON-1852241632 None] snapshot_file for this snap is: volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:57:36 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c52487-5cd7-4bb1-92bf-844a2461eb0b]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-67f3af8d-304d-42e0-93b5-c28c953006be tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:36 devstack sudo[88715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee Apr 21 20:57:36 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:36 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-0a15e7ea-3e3c-44b1-9f3e-9c32f849a5d4 tempest-GroupSnapshotsTest-759127538 None] Update group completed successfully. Apr 21 20:57:36 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-67f3af8d-304d-42e0-93b5-c28c953006be tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee" returned: 0 in 0.650s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:36 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-67f3af8d-304d-42e0-93b5-c28c953006be tempest-VolumesSnapshotListTestJSON-1852241632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1399527b-9a9f-40d4-9949-fe7514ca0e95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:36 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f3c9dd-2465-4351-af51-1366574f5f3c]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-67f3af8d-304d-42e0-93b5-c28c953006be tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:36 devstack sudo[88727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 Apr 21 20:57:36 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:37 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-67f3af8d-304d-42e0-93b5-c28c953006be tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77" returned: 0 in 0.631s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:37 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-67f3af8d-304d-42e0-93b5-c28c953006be tempest-VolumesSnapshotListTestJSON-1852241632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1399527b-9a9f-40d4-9949-fe7514ca0e95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-67f3af8d-304d-42e0-93b5-c28c953006be tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:37 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee Apr 21 20:57:37 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:37 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-d09ee6f6-f4c7-47f9-8bd9-4c5e4b1d854f tempest-GroupSnapshotsTest-759127538 None] Update group completed successfully. Apr 21 20:57:37 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-67f3af8d-304d-42e0-93b5-c28c953006be tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee" returned: 0 in 0.509s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-67f3af8d-304d-42e0-93b5-c28c953006be tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:37 devstack sudo[88738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee Apr 21 20:57:37 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:38 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-67f3af8d-304d-42e0-93b5-c28c953006be tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.f614bc2c-c6d4-4a18-8fa0-45d3628724ee" returned: 0 in 0.434s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:38 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-67f3af8d-304d-42e0-93b5-c28c953006be tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "cinder-quobyte-f614bc2c-c6d4-4a18-8fa0-45d3628724ee" released by "_delete_snapshot" :: held 2.280s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:38 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-67f3af8d-304d-42e0-93b5-c28c953006be tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "cinder-quobyte-1399527b-9a9f-40d4-9949-fe7514ca0e95" released by "delete_snapshot" :: held 2.296s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:38 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-67f3af8d-304d-42e0-93b5-c28c953006be tempest-VolumesSnapshotListTestJSON-1852241632 None] Created reservations ['df9d2d66-8977-4fe8-a214-4fb4c1c5921e', '308e0ad3-9d92-4ab6-a2e4-72f816f68677', '8f6ee672-1bc9-4cda-9898-fac5f1659131', '2982c9f7-3df8-4479-8932-8bdd7eedb969'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:38 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-67f3af8d-304d-42e0-93b5-c28c953006be tempest-VolumesSnapshotListTestJSON-1852241632 None] Delete snapshot completed successfully. Apr 21 20:57:38 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-67f3af8d-304d-42e0-93b5-c28c953006be tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "cinder-f614bc2c-c6d4-4a18-8fa0-45d3628724ee-delete_snapshot" released by "delete_snapshot" :: held 2.380s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:38 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-b906ba8e-1281-4923-a53c-1c7a96f41703 tempest-GroupSnapshotsTest-759127538 None] Update group completed successfully. Apr 21 20:57:39 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a4a6b9bd-2112-493c-b037-184d1d129ce9 tempest-VolumesSnapshotListTestJSON-1852241632 None] Acquiring lock "cinder-dfdcc237-b267-46bd-8c6e-b5a78ccf6a77-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:39 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a4a6b9bd-2112-493c-b037-184d1d129ce9 tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "cinder-dfdcc237-b267-46bd-8c6e-b5a78ccf6a77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:39 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a4a6b9bd-2112-493c-b037-184d1d129ce9 tempest-VolumesSnapshotListTestJSON-1852241632 None] Acquiring lock "cinder-quobyte-1399527b-9a9f-40d4-9949-fe7514ca0e95" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:39 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a4a6b9bd-2112-493c-b037-184d1d129ce9 tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "cinder-quobyte-1399527b-9a9f-40d4-9949-fe7514ca0e95" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:39 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a4a6b9bd-2112-493c-b037-184d1d129ce9 tempest-VolumesSnapshotListTestJSON-1852241632 None] Acquiring lock "cinder-quobyte-dfdcc237-b267-46bd-8c6e-b5a78ccf6a77" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:39 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a4a6b9bd-2112-493c-b037-184d1d129ce9 tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "cinder-quobyte-dfdcc237-b267-46bd-8c6e-b5a78ccf6a77" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-a4a6b9bd-2112-493c-b037-184d1d129ce9 tempest-VolumesSnapshotListTestJSON-1852241632 None] Deleting offline snapshot dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 of volume 1399527b-9a9f-40d4-9949-fe7514ca0e95 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:57:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-a4a6b9bd-2112-493c-b037-184d1d129ce9 tempest-VolumesSnapshotListTestJSON-1852241632 None] snapshot_file for this snap is: volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:57:39 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8a9452-aa98-49ed-b2d9-48026554da43]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4a6b9bd-2112-493c-b037-184d1d129ce9 tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:39 devstack sudo[88742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 Apr 21 20:57:39 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:39 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4a6b9bd-2112-493c-b037-184d1d129ce9 tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77" returned: 0 in 0.460s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-a4a6b9bd-2112-493c-b037-184d1d129ce9 tempest-VolumesSnapshotListTestJSON-1852241632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1399527b-9a9f-40d4-9949-fe7514ca0e95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:39 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[de18253a-355a-404c-8795-e70eaa38412e]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4a6b9bd-2112-493c-b037-184d1d129ce9 tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:39 devstack sudo[88747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95 Apr 21 20:57:39 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:40 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] GroupSnapshot 776f7898-1c81-48bf-8320-a817243b2867: creating. Apr 21 20:57:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] Group snapshot 776f7898-1c81-48bf-8320-a817243b2867: creating. {{(pid=81957) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 21 20:57:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:40 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] Creating offline snapshot 64359320-5f01-4efc-92a0-a96e16e23543 of volume 0e31c706-401d-4e6f-a71a-d31be2ac60fe {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:57:40 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[7680b567-7b2c-471a-9acf-05671e4b54ee]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:40 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe Apr 21 20:57:40 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:40 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4a6b9bd-2112-493c-b037-184d1d129ce9 tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95" returned: 0 in 0.488s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4a6b9bd-2112-493c-b037-184d1d129ce9 tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:40 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 Apr 21 20:57:40 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:40 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe" returned: 0 in 0.517s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.64359320-5f01-4efc-92a0-a96e16e23543 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:40 devstack sudo[88759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.64359320-5f01-4efc-92a0-a96e16e23543 1G Apr 21 20:57:40 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:40 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4a6b9bd-2112-493c-b037-184d1d129ce9 tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77" returned: 0 in 0.478s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4a6b9bd-2112-493c-b037-184d1d129ce9 tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:40 devstack sudo[88764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77 Apr 21 20:57:40 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:41 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.64359320-5f01-4efc-92a0-a96e16e23543 1G" returned: 0 in 0.488s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.64359320-5f01-4efc-92a0-a96e16e23543 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:41 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.64359320-5f01-4efc-92a0-a96e16e23543 Apr 21 20:57:41 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:41 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a4a6b9bd-2112-493c-b037-184d1d129ce9 tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95.dfdcc237-b267-46bd-8c6e-b5a78ccf6a77" returned: 0 in 0.427s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:41 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a4a6b9bd-2112-493c-b037-184d1d129ce9 tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "cinder-quobyte-dfdcc237-b267-46bd-8c6e-b5a78ccf6a77" released by "_delete_snapshot" :: held 1.906s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:41 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a4a6b9bd-2112-493c-b037-184d1d129ce9 tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "cinder-quobyte-1399527b-9a9f-40d4-9949-fe7514ca0e95" released by "delete_snapshot" :: held 1.918s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:41 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-a4a6b9bd-2112-493c-b037-184d1d129ce9 tempest-VolumesSnapshotListTestJSON-1852241632 None] Created reservations ['5561519d-426d-4cd0-a5cc-34fea9c3e9c5', '36b96d63-004e-4782-8ec1-ee3b21eb88ac', '579ff069-69a8-4904-bc2a-13451d0ebead', '8275c2d4-7147-439b-8bc4-0cd2b45cddfb'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:41 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-a4a6b9bd-2112-493c-b037-184d1d129ce9 tempest-VolumesSnapshotListTestJSON-1852241632 None] Delete snapshot completed successfully. Apr 21 20:57:41 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a4a6b9bd-2112-493c-b037-184d1d129ce9 tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "cinder-dfdcc237-b267-46bd-8c6e-b5a78ccf6a77-delete_snapshot" released by "delete_snapshot" :: held 2.006s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:41 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c9656c11-d0c1-4c15-ae0b-c57739bbef83 tempest-VolumesSnapshotListTestJSON-1852241632 None] Acquiring lock "cinder-1399527b-9a9f-40d4-9949-fe7514ca0e95-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:41 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c9656c11-d0c1-4c15-ae0b-c57739bbef83 tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "cinder-1399527b-9a9f-40d4-9949-fe7514ca0e95-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:41 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c9656c11-d0c1-4c15-ae0b-c57739bbef83 tempest-VolumesSnapshotListTestJSON-1852241632 None] Acquiring lock "cinder-quobyte-1399527b-9a9f-40d4-9949-fe7514ca0e95" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:41 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c9656c11-d0c1-4c15-ae0b-c57739bbef83 tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "cinder-quobyte-1399527b-9a9f-40d4-9949-fe7514ca0e95" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:41 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[2705ea0d-e54b-44cd-9188-51494e092765]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c9656c11-d0c1-4c15-ae0b-c57739bbef83 tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:41 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95 Apr 21 20:57:41 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:41 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.64359320-5f01-4efc-92a0-a96e16e23543" returned: 0 in 0.459s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:41 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.64359320-5f01-4efc-92a0-a96e16e23543 is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:57:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.64359320-5f01-4efc-92a0-a96e16e23543 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:41 devstack sudo[88777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.64359320-5f01-4efc-92a0-a96e16e23543 Apr 21 20:57:41 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:42 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c9656c11-d0c1-4c15-ae0b-c57739bbef83 tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95" returned: 0 in 0.496s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c9656c11-d0c1-4c15-ae0b-c57739bbef83 tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:42 devstack sudo[88783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95 Apr 21 20:57:42 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:42 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.64359320-5f01-4efc-92a0-a96e16e23543" returned: 0 in 0.433s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:42 devstack sudo[88785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.info Apr 21 20:57:42 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:42 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c9656c11-d0c1-4c15-ae0b-c57739bbef83 tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-1399527b-9a9f-40d4-9949-fe7514ca0e95" returned: 0 in 0.430s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:42 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c9656c11-d0c1-4c15-ae0b-c57739bbef83 tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "cinder-quobyte-1399527b-9a9f-40d4-9949-fe7514ca0e95" released by "delete_volume" :: held 0.966s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:42 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-c9656c11-d0c1-4c15-ae0b-c57739bbef83 tempest-VolumesSnapshotListTestJSON-1852241632 None] Created reservations ['e39b50d9-04dc-49ff-9682-a5163f940088', 'ee988fdf-a322-4fba-a1e4-b24cd8e17321', '37aa9b6d-e213-490c-8e5b-e1dec935208c', '55bcdc4a-86b7-4a85-b40c-5fb8bff9a0dd'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:42 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.info" returned: 0 in 0.462s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:42 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:57:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:42 devstack sudo[88789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.info Apr 21 20:57:42 devstack sudo[88789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c9656c11-d0c1-4c15-ae0b-c57739bbef83 tempest-VolumesSnapshotListTestJSON-1852241632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c9656c11-d0c1-4c15-ae0b-c57739bbef83 tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:42 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c9656c11-d0c1-4c15-ae0b-c57739bbef83 tempest-VolumesSnapshotListTestJSON-1852241632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:42 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c9656c11-d0c1-4c15-ae0b-c57739bbef83 tempest-VolumesSnapshotListTestJSON-1852241632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c9656c11-d0c1-4c15-ae0b-c57739bbef83 tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c9656c11-d0c1-4c15-ae0b-c57739bbef83 tempest-VolumesSnapshotListTestJSON-1852241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:42 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:57:42 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:43 devstack sudo[88789]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.info" returned: 0 in 0.526s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:43 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.937s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c9656c11-d0c1-4c15-ae0b-c57739bbef83 tempest-VolumesSnapshotListTestJSON-1852241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.499s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:43 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-c9656c11-d0c1-4c15-ae0b-c57739bbef83 tempest-VolumesSnapshotListTestJSON-1852241632 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] Creating offline snapshot d466b691-f527-4b5b-8366-34a93f29cf09 of volume 4cf5fb47-7895-4421-b90e-26a61e5ecf71 {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:57:43 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-c9656c11-d0c1-4c15-ae0b-c57739bbef83 tempest-VolumesSnapshotListTestJSON-1852241632 None] Deleted volume successfully. Apr 21 20:57:43 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[30753c83-5cb1-493e-abbf-5aa0be05cee6]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c9656c11-d0c1-4c15-ae0b-c57739bbef83 tempest-VolumesSnapshotListTestJSON-1852241632 None] Lock "cinder-1399527b-9a9f-40d4-9949-fe7514ca0e95-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:43 devstack sudo[88795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71 Apr 21 20:57:43 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:43 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71" returned: 0 in 0.579s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.d466b691-f527-4b5b-8366-34a93f29cf09 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:43 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.d466b691-f527-4b5b-8366-34a93f29cf09 1G Apr 21 20:57:43 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:44 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.d466b691-f527-4b5b-8366-34a93f29cf09 1G" returned: 0 in 0.516s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.d466b691-f527-4b5b-8366-34a93f29cf09 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:44 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.d466b691-f527-4b5b-8366-34a93f29cf09 Apr 21 20:57:44 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:SELECT=186,cinder:INSERT=62,cinder:UPDATE=184,cinder:DELETE=12 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:SELECT=162,cinder:UPDATE=198,cinder:DELETE=15,cinder:INSERT=42 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Flow 'volume_create_manager' (f3af3c93-8c16-40ed-b995-71e0af4e24d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd7c6d2c-44bc-473b-a424-4cac7ee0bc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd7c6d2c-44bc-473b-a424-4cac7ee0bc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1279751953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a0f610b-9508-4944-b7e7-a6495248a028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe4444617dc4d14a4939d7d358c5846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:44Z,use_quota=True,user_id='51da81da96ad4db3ad83affe33c6121b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c2b6c2-586f-4049-abdc-b1a4fbbce7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c2b6c2-586f-4049-abdc-b1a4fbbce7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90ae527-2458-40d1-8208-a1c74f92d183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90ae527-2458-40d1-8208-a1c74f92d183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a0f610b-9508-4944-b7e7-a6495248a028', 'volume_name': 'volume-9a0f610b-9508-4944-b7e7-a6495248a028', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (852f6e81-7f4c-4ef1-9ebc-b20120e57b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (852f6e81-7f4c-4ef1-9ebc-b20120e57b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5634336f-b5cb-4122-aa25-acf735bfb38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:44 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Volume 9a0f610b-9508-4944-b7e7-a6495248a028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a0f610b-9508-4944-b7e7-a6495248a028', 'volume_size': 1} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:44 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Flow 'volume_create_manager' (8d1d69f9-9b71-4ec3-a4f4-ed56bb20fb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bee19a8-8045-4b6e-8cfb-3f556478bf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.d466b691-f527-4b5b-8366-34a93f29cf09" returned: 0 in 0.561s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:44 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.d466b691-f527-4b5b-8366-34a93f29cf09 is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.d466b691-f527-4b5b-8366-34a93f29cf09 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bee19a8-8045-4b6e-8cfb-3f556478bf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1922407400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56d8f470-4b2d-42df-8e99-aaf615ba28bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe4444617dc4d14a4939d7d358c5846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:45Z,use_quota=True,user_id='51da81da96ad4db3ad83affe33c6121b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:44 devstack sudo[88812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.d466b691-f527-4b5b-8366-34a93f29cf09 Apr 21 20:57:44 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b15d0f72-a052-48c3-b6f4-9614c011ad72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b15d0f72-a052-48c3-b6f4-9614c011ad72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f703c4f4-d11c-4b8e-8d01-7cb354394026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f703c4f4-d11c-4b8e-8d01-7cb354394026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56d8f470-4b2d-42df-8e99-aaf615ba28bd', 'volume_name': 'volume-56d8f470-4b2d-42df-8e99-aaf615ba28bd', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab1423bb-e3e8-423a-9193-8e0957f9a8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab1423bb-e3e8-423a-9193-8e0957f9a8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38eb0ab-f04a-4b4c-8106-8609d5a6fd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:44 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Volume 56d8f470-4b2d-42df-8e99-aaf615ba28bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56d8f470-4b2d-42df-8e99-aaf615ba28bd', 'volume_size': 1} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Flow 'volume_create_manager' (b9158c96-ecdb-455d-b0af-9482a031613a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e11ef60a-c7a2-40cc-9827-19a545168036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e11ef60a-c7a2-40cc-9827-19a545168036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1955338400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f060b2-2ca3-4b51-8606-a943e7be86cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe4444617dc4d14a4939d7d358c5846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:45Z,use_quota=True,user_id='51da81da96ad4db3ad83affe33c6121b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8012947d-62fc-44aa-8686-f5025901cb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:44 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8012947d-62fc-44aa-8686-f5025901cb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce75df5-6e26-4a21-ac8e-5541ed002a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce75df5-6e26-4a21-ac8e-5541ed002a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90f060b2-2ca3-4b51-8606-a943e7be86cc', 'volume_name': 'volume-90f060b2-2ca3-4b51-8606-a943e7be86cc', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c90884-d753-4f1c-8bbf-2f9cbdcbfdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c90884-d753-4f1c-8bbf-2f9cbdcbfdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1611a546-2fe6-469a-85b3-09e5dd54b0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:45 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Volume 90f060b2-2ca3-4b51-8606-a943e7be86cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90f060b2-2ca3-4b51-8606-a943e7be86cc', 'volume_size': 1} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Flow 'volume_create_manager' (3b4e7fb0-8280-4bf2-8a67-234544da4bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f81f3e-98ca-4632-aad2-f0899acd92b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f81f3e-98ca-4632-aad2-f0899acd92b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-549247079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe49ad19-fde9-4b2f-be0b-78dd218f9f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe4444617dc4d14a4939d7d358c5846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:45Z,use_quota=True,user_id='51da81da96ad4db3ad83affe33c6121b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e94c420-ade9-44ac-8888-8a843974eaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e94c420-ade9-44ac-8888-8a843974eaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d18853bf-cc01-4af7-a539-e623b3f8e687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d18853bf-cc01-4af7-a539-e623b3f8e687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe49ad19-fde9-4b2f-be0b-78dd218f9f27', 'volume_name': 'volume-fe49ad19-fde9-4b2f-be0b-78dd218f9f27', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86020481-30b8-4f8a-902e-97e3bab6fbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86020481-30b8-4f8a-902e-97e3bab6fbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66886328-93bb-4c3b-9bae-c28e36cda7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:45 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Volume fe49ad19-fde9-4b2f-be0b-78dd218f9f27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe49ad19-fde9-4b2f-be0b-78dd218f9f27', 'volume_size': 1} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:45 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.d466b691-f527-4b5b-8366-34a93f29cf09" returned: 0 in 0.530s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:45 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.info Apr 21 20:57:45 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Flow 'volume_create_manager' (a61c7827-bbaa-4b8a-9e2b-372b6a8690c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2edde1-f5dc-4e6e-bd4c-8c81667c2493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2edde1-f5dc-4e6e-bd4c-8c81667c2493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1380761993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8fa4465-acc8-41f9-957f-0ee87f6d1afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe4444617dc4d14a4939d7d358c5846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:45Z,use_quota=True,user_id='51da81da96ad4db3ad83affe33c6121b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b36e3365-7ee8-4d2e-9281-35bece5ea45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b36e3365-7ee8-4d2e-9281-35bece5ea45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2132611b-1344-4549-b1ba-040ed02ddefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2132611b-1344-4549-b1ba-040ed02ddefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8fa4465-acc8-41f9-957f-0ee87f6d1afe', 'volume_name': 'volume-a8fa4465-acc8-41f9-957f-0ee87f6d1afe', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee6eb0b-6805-400c-bce8-00a5580af498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee6eb0b-6805-400c-bce8-00a5580af498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7013088c-aed7-46bf-b581-9de05e6b74e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:45 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Volume a8fa4465-acc8-41f9-957f-0ee87f6d1afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8fa4465-acc8-41f9-957f-0ee87f6d1afe', 'volume_size': 1} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:45 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.info" returned: 0 in 0.498s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:45 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:45 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.info Apr 21 20:57:45 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-502368f7-4486-4bad-952a-7cc712d08b96 tempest-VolumesNegativeTest-2045745841 None] Acquiring lock "cinder-b11ba953-c104-4b24-a257-1c9147fbe895-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:45 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-502368f7-4486-4bad-952a-7cc712d08b96 tempest-VolumesNegativeTest-2045745841 None] Lock "cinder-b11ba953-c104-4b24-a257-1c9147fbe895-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-502368f7-4486-4bad-952a-7cc712d08b96 tempest-VolumesNegativeTest-2045745841 None] Acquiring lock "cinder-quobyte-b11ba953-c104-4b24-a257-1c9147fbe895" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-502368f7-4486-4bad-952a-7cc712d08b96 tempest-VolumesNegativeTest-2045745841 None] Lock "cinder-quobyte-b11ba953-c104-4b24-a257-1c9147fbe895" acquired by "delete_volume" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:46 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7d97b7-a728-42f6-aa0b-355a29cac6bb]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-502368f7-4486-4bad-952a-7cc712d08b96 tempest-VolumesNegativeTest-2045745841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b11ba953-c104-4b24-a257-1c9147fbe895 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:46 devstack sudo[88820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b11ba953-c104-4b24-a257-1c9147fbe895 Apr 21 20:57:46 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:46 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.info" returned: 0 in 0.450s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.197s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.695s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1279751953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a0f610b-9508-4944-b7e7-a6495248a028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe4444617dc4d14a4939d7d358c5846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:44Z,use_quota=True,user_id='51da81da96ad4db3ad83affe33c6121b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Creating volume 9a0f610b-9508-4944-b7e7-a6495248a028 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:46 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:57:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a0f610b-9508-4944-b7e7-a6495248a028 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:46 devstack sudo[88823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a0f610b-9508-4944-b7e7-a6495248a028 1073741824 Apr 21 20:57:46 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:46 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-a94f0fa1-5cc9-42ee-a047-bc8320bf931a tempest-GroupSnapshotsTest-759127538 None] group_snapshot 776f7898-1c81-48bf-8320-a817243b2867: created successfully Apr 21 20:57:46 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-502368f7-4486-4bad-952a-7cc712d08b96 tempest-VolumesNegativeTest-2045745841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b11ba953-c104-4b24-a257-1c9147fbe895" returned: 0 in 0.479s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-502368f7-4486-4bad-952a-7cc712d08b96 tempest-VolumesNegativeTest-2045745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b11ba953-c104-4b24-a257-1c9147fbe895 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:46 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b11ba953-c104-4b24-a257-1c9147fbe895 Apr 21 20:57:46 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:46 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a0f610b-9508-4944-b7e7-a6495248a028 1073741824" returned: 0 in 0.470s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a0f610b-9508-4944-b7e7-a6495248a028 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:46 devstack sudo[88833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a0f610b-9508-4944-b7e7-a6495248a028 Apr 21 20:57:46 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:46 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-502368f7-4486-4bad-952a-7cc712d08b96 tempest-VolumesNegativeTest-2045745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b11ba953-c104-4b24-a257-1c9147fbe895" returned: 0 in 0.403s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-502368f7-4486-4bad-952a-7cc712d08b96 tempest-VolumesNegativeTest-2045745841 None] Lock "cinder-quobyte-b11ba953-c104-4b24-a257-1c9147fbe895" released by "delete_volume" :: held 0.901s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:46 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-502368f7-4486-4bad-952a-7cc712d08b96 tempest-VolumesNegativeTest-2045745841 None] Created reservations ['afaa14e4-8f56-4d84-9131-85d18ee76172', '799d9b99-254f-4451-9a1a-7811f7c68946', '87b15a0f-3979-4459-9a04-29b0a61366aa', '955f925d-fe13-420b-9f9b-c1e418ab88e9'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-502368f7-4486-4bad-952a-7cc712d08b96 tempest-VolumesNegativeTest-2045745841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-502368f7-4486-4bad-952a-7cc712d08b96 tempest-VolumesNegativeTest-2045745841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-502368f7-4486-4bad-952a-7cc712d08b96 tempest-VolumesNegativeTest-2045745841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-502368f7-4486-4bad-952a-7cc712d08b96 tempest-VolumesNegativeTest-2045745841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-502368f7-4486-4bad-952a-7cc712d08b96 tempest-VolumesNegativeTest-2045745841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-502368f7-4486-4bad-952a-7cc712d08b96 tempest-VolumesNegativeTest-2045745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:47 devstack sudo[88836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:57:47 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:47 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a0f610b-9508-4944-b7e7-a6495248a028" returned: 0 in 0.409s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.375s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1922407400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56d8f470-4b2d-42df-8e99-aaf615ba28bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe4444617dc4d14a4939d7d358c5846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:45Z,use_quota=True,user_id='51da81da96ad4db3ad83affe33c6121b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Creating volume 56d8f470-4b2d-42df-8e99-aaf615ba28bd {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:47 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-56d8f470-4b2d-42df-8e99-aaf615ba28bd 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5634336f-b5cb-4122-aa25-acf735bfb38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a0f610b-9508-4944-b7e7-a6495248a028', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:47 devstack sudo[88839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-56d8f470-4b2d-42df-8e99-aaf615ba28bd 1073741824 Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3f5b76-6b61-4d40-b386-09fbb9b4c825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:47 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:47 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Volume volume-9a0f610b-9508-4944-b7e7-a6495248a028 (9a0f610b-9508-4944-b7e7-a6495248a028): created successfully Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3f5b76-6b61-4d40-b386-09fbb9b4c825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Flow 'volume_create_manager' (f3af3c93-8c16-40ed-b995-71e0af4e24d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:47 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-87ecfffe-03f6-42e1-a2bf-b21904854d42 tempest-CreateVolumesFromImageTest-529775158 None] Created volume successfully. Apr 21 20:57:47 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-502368f7-4486-4bad-952a-7cc712d08b96 tempest-VolumesNegativeTest-2045745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.493s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-502368f7-4486-4bad-952a-7cc712d08b96 tempest-VolumesNegativeTest-2045745841 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:47 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-502368f7-4486-4bad-952a-7cc712d08b96 tempest-VolumesNegativeTest-2045745841 None] Deleted volume successfully. Apr 21 20:57:47 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] group_snapshot 776f7898-1c81-48bf-8320-a817243b2867: deleting Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-502368f7-4486-4bad-952a-7cc712d08b96 tempest-VolumesNegativeTest-2045745841 None] Lock "cinder-b11ba953-c104-4b24-a257-1c9147fbe895-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] group_snapshot 776f7898-1c81-48bf-8320-a817243b2867: deleting {{(pid=81957) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "cinder-quobyte-0e31c706-401d-4e6f-a71a-d31be2ac60fe" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-0e31c706-401d-4e6f-a71a-d31be2ac60fe" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "cinder-quobyte-64359320-5f01-4efc-92a0-a96e16e23543" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-64359320-5f01-4efc-92a0-a96e16e23543" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Deleting offline snapshot 64359320-5f01-4efc-92a0-a96e16e23543 of volume 0e31c706-401d-4e6f-a71a-d31be2ac60fe {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] snapshot_file for this snap is: volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.64359320-5f01-4efc-92a0-a96e16e23543 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[239f34f2-083b-42d7-9d24-8bc95f498caa]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.64359320-5f01-4efc-92a0-a96e16e23543 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:47 devstack sudo[88845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.64359320-5f01-4efc-92a0-a96e16e23543 Apr 21 20:57:47 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:47 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-56d8f470-4b2d-42df-8e99-aaf615ba28bd 1073741824" returned: 0 in 0.572s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-56d8f470-4b2d-42df-8e99-aaf615ba28bd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:47 devstack sudo[88847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-56d8f470-4b2d-42df-8e99-aaf615ba28bd Apr 21 20:57:47 devstack sudo[88847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:48 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.64359320-5f01-4efc-92a0-a96e16e23543" returned: 0 in 0.585s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[02df0092-3cb4-4318-9201-ad5ba88999eb]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:48 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe Apr 21 20:57:48 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:48 devstack sudo[88847]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-56d8f470-4b2d-42df-8e99-aaf615ba28bd" returned: 0 in 0.488s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.265s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1955338400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f060b2-2ca3-4b51-8606-a943e7be86cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe4444617dc4d14a4939d7d358c5846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:45Z,use_quota=True,user_id='51da81da96ad4db3ad83affe33c6121b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Creating volume 90f060b2-2ca3-4b51-8606-a943e7be86cc {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:48 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-90f060b2-2ca3-4b51-8606-a943e7be86cc 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38eb0ab-f04a-4b4c-8106-8609d5a6fd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56d8f470-4b2d-42df-8e99-aaf615ba28bd', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c6db82-a0c7-4861-9f8e-1981d3d8bb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:48 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-90f060b2-2ca3-4b51-8606-a943e7be86cc 1073741824 Apr 21 20:57:48 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:48 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Volume volume-56d8f470-4b2d-42df-8e99-aaf615ba28bd (56d8f470-4b2d-42df-8e99-aaf615ba28bd): created successfully Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c6db82-a0c7-4861-9f8e-1981d3d8bb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Flow 'volume_create_manager' (8d1d69f9-9b71-4ec3-a4f4-ed56bb20fb34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:48 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-17dae500-4b19-4a12-8a48-884911c1812e tempest-CreateVolumesFromImageTest-529775158 None] Created volume successfully. Apr 21 20:57:48 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe" returned: 0 in 0.553s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.64359320-5f01-4efc-92a0-a96e16e23543 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:48 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.64359320-5f01-4efc-92a0-a96e16e23543 Apr 21 20:57:48 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:48 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-90f060b2-2ca3-4b51-8606-a943e7be86cc 1073741824" returned: 0 in 0.498s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-90f060b2-2ca3-4b51-8606-a943e7be86cc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:48 devstack sudo[88866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-90f060b2-2ca3-4b51-8606-a943e7be86cc Apr 21 20:57:48 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:49 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.64359320-5f01-4efc-92a0-a96e16e23543" returned: 0 in 0.455s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.64359320-5f01-4efc-92a0-a96e16e23543 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:49 devstack sudo[88873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.64359320-5f01-4efc-92a0-a96e16e23543 Apr 21 20:57:49 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:49 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-90f060b2-2ca3-4b51-8606-a943e7be86cc" returned: 0 in 0.462s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.008s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-549247079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe49ad19-fde9-4b2f-be0b-78dd218f9f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe4444617dc4d14a4939d7d358c5846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:45Z,use_quota=True,user_id='51da81da96ad4db3ad83affe33c6121b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Creating volume fe49ad19-fde9-4b2f-be0b-78dd218f9f27 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:49 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fe49ad19-fde9-4b2f-be0b-78dd218f9f27 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1611a546-2fe6-469a-85b3-09e5dd54b0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90f060b2-2ca3-4b51-8606-a943e7be86cc', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3adac0ae-59cc-428c-b3b4-1289384be0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:49 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Volume volume-90f060b2-2ca3-4b51-8606-a943e7be86cc (90f060b2-2ca3-4b51-8606-a943e7be86cc): created successfully Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3adac0ae-59cc-428c-b3b4-1289384be0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:49 devstack sudo[88875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fe49ad19-fde9-4b2f-be0b-78dd218f9f27 1073741824 Apr 21 20:57:49 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Flow 'volume_create_manager' (b9158c96-ecdb-455d-b0af-9482a031613a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:49 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-a073fe97-6824-4ed8-b5dd-4cad06ce7db8 tempest-CreateVolumesFromImageTest-529775158 None] Created volume successfully. Apr 21 20:57:49 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe.64359320-5f01-4efc-92a0-a96e16e23543" returned: 0 in 0.394s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-64359320-5f01-4efc-92a0-a96e16e23543" released by "_delete_snapshot" :: held 2.036s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-0e31c706-401d-4e6f-a71a-d31be2ac60fe" released by "delete_snapshot" :: held 2.047s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "cinder-quobyte-4cf5fb47-7895-4421-b90e-26a61e5ecf71" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-4cf5fb47-7895-4421-b90e-26a61e5ecf71" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "cinder-quobyte-d466b691-f527-4b5b-8366-34a93f29cf09" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-d466b691-f527-4b5b-8366-34a93f29cf09" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Deleting offline snapshot d466b691-f527-4b5b-8366-34a93f29cf09 of volume 4cf5fb47-7895-4421-b90e-26a61e5ecf71 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] snapshot_file for this snap is: volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.d466b691-f527-4b5b-8366-34a93f29cf09 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce85f5b0-cb9b-4653-8d53-60f21c0818d4]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.d466b691-f527-4b5b-8366-34a93f29cf09 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:49 devstack sudo[88878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.d466b691-f527-4b5b-8366-34a93f29cf09 Apr 21 20:57:49 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:49 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fe49ad19-fde9-4b2f-be0b-78dd218f9f27 1073741824" returned: 0 in 0.665s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fe49ad19-fde9-4b2f-be0b-78dd218f9f27 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:49 devstack sudo[88883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fe49ad19-fde9-4b2f-be0b-78dd218f9f27 Apr 21 20:57:49 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:50 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.d466b691-f527-4b5b-8366-34a93f29cf09" returned: 0 in 0.500s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1263802-1507-4428-9bc0-ec88a2d0f497]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:50 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71 Apr 21 20:57:50 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:50 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fe49ad19-fde9-4b2f-be0b-78dd218f9f27" returned: 0 in 0.479s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.952s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1380761993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8fa4465-acc8-41f9-957f-0ee87f6d1afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe4444617dc4d14a4939d7d358c5846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:45Z,use_quota=True,user_id='51da81da96ad4db3ad83affe33c6121b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Creating volume a8fa4465-acc8-41f9-957f-0ee87f6d1afe {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:50 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8fa4465-acc8-41f9-957f-0ee87f6d1afe 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66886328-93bb-4c3b-9bae-c28e36cda7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe49ad19-fde9-4b2f-be0b-78dd218f9f27', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:50 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8fa4465-acc8-41f9-957f-0ee87f6d1afe 1073741824 Apr 21 20:57:50 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b2c5a8-8e0d-44e4-adad-77d6ac4e20a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:50 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Volume volume-fe49ad19-fde9-4b2f-be0b-78dd218f9f27 (fe49ad19-fde9-4b2f-be0b-78dd218f9f27): created successfully Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b2c5a8-8e0d-44e4-adad-77d6ac4e20a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Flow 'volume_create_manager' (3b4e7fb0-8280-4bf2-8a67-234544da4bb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:50 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-0feb847b-8bab-4f4c-ba09-c653415ae97f tempest-CreateVolumesFromImageTest-529775158 None] Created volume successfully. Apr 21 20:57:50 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71" returned: 0 in 0.490s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.d466b691-f527-4b5b-8366-34a93f29cf09 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:50 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.d466b691-f527-4b5b-8366-34a93f29cf09 Apr 21 20:57:50 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:50 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8fa4465-acc8-41f9-957f-0ee87f6d1afe 1073741824" returned: 0 in 0.512s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8fa4465-acc8-41f9-957f-0ee87f6d1afe {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:51 devstack sudo[88901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8fa4465-acc8-41f9-957f-0ee87f6d1afe Apr 21 20:57:51 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:51 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.d466b691-f527-4b5b-8366-34a93f29cf09" returned: 0 in 0.495s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.d466b691-f527-4b5b-8366-34a93f29cf09 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:51 devstack sudo[88906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.d466b691-f527-4b5b-8366-34a93f29cf09 Apr 21 20:57:51 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:51 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8fa4465-acc8-41f9-957f-0ee87f6d1afe" returned: 0 in 0.405s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:51 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:51 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7013088c-aed7-46bf-b581-9de05e6b74e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8fa4465-acc8-41f9-957f-0ee87f6d1afe', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:51 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8b0d37-c9b6-46ac-83fd-2d5193846eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:51 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Volume volume-a8fa4465-acc8-41f9-957f-0ee87f6d1afe (a8fa4465-acc8-41f9-957f-0ee87f6d1afe): created successfully Apr 21 20:57:51 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8b0d37-c9b6-46ac-83fd-2d5193846eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:51 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Flow 'volume_create_manager' (a61c7827-bbaa-4b8a-9e2b-372b6a8690c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:51 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-d7747fb8-dca4-480e-a7a4-9ff575840ab8 tempest-CreateVolumesFromImageTest-529775158 None] Created volume successfully. Apr 21 20:57:51 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71.d466b691-f527-4b5b-8366-34a93f29cf09" returned: 0 in 0.426s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-d466b691-f527-4b5b-8366-34a93f29cf09" released by "_delete_snapshot" :: held 1.958s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-4cf5fb47-7895-4421-b90e-26a61e5ecf71" released by "delete_snapshot" :: held 1.969s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:51 devstack cinder-volume[81957]: WARNING cinder.quota [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-357195812 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-357195812, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:57:51 devstack cinder-volume[81957]: WARNING cinder.quota [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-357195812 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-357195812, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:57:51 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Created reservations ['a757ef04-472d-4ff0-884f-63d9d9e62243', 'fa61e466-831f-4cb6-8ee4-c962f54a47af', '61391d01-2787-4d46-97f6-62d33cc96dc1', '0fce78c3-cc78-49b5-abfb-7b2fa0e43726'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:51 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] Created reservations ['6a126026-5b7b-4fd0-a5f1-89251e967420', 'f967bf1e-dbbd-44e3-a1fb-73f4ef912b1d', '048d20e1-e15f-4d42-8f88-2b53008002aa', 'c7f5ab67-b198-471a-98c4-97d1f4a4b3a5'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:51 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-6a9007f3-379e-41b3-9a31-2eaa5750d0fb tempest-GroupSnapshotsTest-759127538 None] group_snapshot 776f7898-1c81-48bf-8320-a817243b2867: deleted successfully Apr 21 20:57:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3ada4b31-31f0-449f-86a0-bd2772c977cc tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "cinder-a8fa4465-acc8-41f9-957f-0ee87f6d1afe-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3ada4b31-31f0-449f-86a0-bd2772c977cc tempest-CreateVolumesFromImageTest-529775158 None] Lock "cinder-a8fa4465-acc8-41f9-957f-0ee87f6d1afe-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "cinder-quobyte-0e31c706-401d-4e6f-a71a-d31be2ac60fe" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3ada4b31-31f0-449f-86a0-bd2772c977cc tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "cinder-quobyte-a8fa4465-acc8-41f9-957f-0ee87f6d1afe" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-0e31c706-401d-4e6f-a71a-d31be2ac60fe" acquired by "delete_volume" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3ada4b31-31f0-449f-86a0-bd2772c977cc tempest-CreateVolumesFromImageTest-529775158 None] Lock "cinder-quobyte-a8fa4465-acc8-41f9-957f-0ee87f6d1afe" acquired by "delete_volume" :: waited 0.023s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:52 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[046a0992-6874-463c-b9d6-367cc6a37f5d]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:52 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[422528d9-4e94-4d83-83d8-853e127607fd]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3ada4b31-31f0-449f-86a0-bd2772c977cc tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8fa4465-acc8-41f9-957f-0ee87f6d1afe {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:52 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe Apr 21 20:57:52 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:52 devstack sudo[88911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8fa4465-acc8-41f9-957f-0ee87f6d1afe Apr 21 20:57:52 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:52 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe" returned: 0 in 0.478s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:52 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3ada4b31-31f0-449f-86a0-bd2772c977cc tempest-CreateVolumesFromImageTest-529775158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8fa4465-acc8-41f9-957f-0ee87f6d1afe" returned: 0 in 0.487s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3ada4b31-31f0-449f-86a0-bd2772c977cc tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8fa4465-acc8-41f9-957f-0ee87f6d1afe {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:52 devstack sudo[88920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe Apr 21 20:57:52 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:52 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8fa4465-acc8-41f9-957f-0ee87f6d1afe Apr 21 20:57:52 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:52 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:52 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0e31c706-401d-4e6f-a71a-d31be2ac60fe" returned: 0 in 0.428s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3ada4b31-31f0-449f-86a0-bd2772c977cc tempest-CreateVolumesFromImageTest-529775158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a8fa4465-acc8-41f9-957f-0ee87f6d1afe" returned: 0 in 0.415s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-0e31c706-401d-4e6f-a71a-d31be2ac60fe" released by "delete_volume" :: held 0.940s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "cinder-quobyte-4cf5fb47-7895-4421-b90e-26a61e5ecf71" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3ada4b31-31f0-449f-86a0-bd2772c977cc tempest-CreateVolumesFromImageTest-529775158 None] Lock "cinder-quobyte-a8fa4465-acc8-41f9-957f-0ee87f6d1afe" released by "delete_volume" :: held 0.928s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-4cf5fb47-7895-4421-b90e-26a61e5ecf71" acquired by "delete_volume" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[12963c0c-ec5c-4c09-8af3-df896c7496fa]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-3ada4b31-31f0-449f-86a0-bd2772c977cc tempest-CreateVolumesFromImageTest-529775158 None] Created reservations ['a0d878f4-f601-4ac6-8103-3a842f297e6e', 'c113416f-af70-4f3c-be79-cc98b5812911', '0b377032-3e5d-4c4a-8abd-04ef3c42c471', '6d5d003f-0529-4df0-8eee-40a2e1d53057'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:53 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71 Apr 21 20:57:53 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3ada4b31-31f0-449f-86a0-bd2772c977cc tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3ada4b31-31f0-449f-86a0-bd2772c977cc tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3ada4b31-31f0-449f-86a0-bd2772c977cc tempest-CreateVolumesFromImageTest-529775158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3ada4b31-31f0-449f-86a0-bd2772c977cc tempest-CreateVolumesFromImageTest-529775158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3ada4b31-31f0-449f-86a0-bd2772c977cc tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3ada4b31-31f0-449f-86a0-bd2772c977cc tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:53 devstack sudo[88928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:57:53 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:53 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3ada4b31-31f0-449f-86a0-bd2772c977cc tempest-CreateVolumesFromImageTest-529775158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.390s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-3ada4b31-31f0-449f-86a0-bd2772c977cc tempest-CreateVolumesFromImageTest-529775158 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:53 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:53 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-3ada4b31-31f0-449f-86a0-bd2772c977cc tempest-CreateVolumesFromImageTest-529775158 None] Deleted volume successfully. Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71" returned: 0 in 0.495s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3ada4b31-31f0-449f-86a0-bd2772c977cc tempest-CreateVolumesFromImageTest-529775158 None] Lock "cinder-a8fa4465-acc8-41f9-957f-0ee87f6d1afe-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:53 devstack sudo[88934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71 Apr 21 20:57:53 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG oslo_service.periodic_task [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81957) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:53 devstack sudo[88936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:57:53 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:53 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4cf5fb47-7895-4421-b90e-26a61e5ecf71" returned: 0 in 0.398s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-4cf5fb47-7895-4421-b90e-26a61e5ecf71" released by "delete_volume" :: held 0.919s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:53 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] Created reservations ['5bf345ea-f4b7-4cb2-a082-4942a2a71c2e'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:54 devstack cinder-volume[81957]: WARNING cinder.quota [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-357195812 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-357195812, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:57:54 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] Created reservations ['b5ef97ae-a101-4385-9863-5c027a136d44', '632b7ecf-507c-4173-9dfb-d416432656b2', '967e2e96-c906-4929-9c8c-9c6378bac14e', 'be48b8a3-d7ac-4b60-8726-7b5dc863f20e'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:54 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] Created reservations ['2eb853da-c2af-487f-916d-6a4670f863c6', '97d6d327-5cca-42eb-a174-739cd8176f4d', '02665920-e498-4eef-9423-1fa15f097e3d', 'dad32d5a-c3b9-48f0-8f00-26b1e52229a3'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:54 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7d638443-5308-454f-bcdb-6f1c32605035 tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "cinder-fe49ad19-fde9-4b2f-be0b-78dd218f9f27-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:54 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:54 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:54 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7d638443-5308-454f-bcdb-6f1c32605035 tempest-CreateVolumesFromImageTest-529775158 None] Lock "cinder-fe49ad19-fde9-4b2f-be0b-78dd218f9f27-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:54 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7d638443-5308-454f-bcdb-6f1c32605035 tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "cinder-quobyte-fe49ad19-fde9-4b2f-be0b-78dd218f9f27" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:54 devstack sudo[88939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:57:54 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7d638443-5308-454f-bcdb-6f1c32605035 tempest-CreateVolumesFromImageTest-529775158 None] Lock "cinder-quobyte-fe49ad19-fde9-4b2f-be0b-78dd218f9f27" acquired by "delete_volume" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:54 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:54 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d676ae-f1b5-4db4-b3e5-4e9a6e628550]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7d638443-5308-454f-bcdb-6f1c32605035 tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fe49ad19-fde9-4b2f-be0b-78dd218f9f27 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:54 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fe49ad19-fde9-4b2f-be0b-78dd218f9f27 Apr 21 20:57:54 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:54 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.485s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:54 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:54 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-86df068d-1662-47a5-b90b-621a424dd34f tempest-GroupSnapshotsTest-759127538 None] Group tempest-GroupSnapshotsTest-Group-1659672195: creating Apr 21 20:57:54 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-86df068d-1662-47a5-b90b-621a424dd34f tempest-GroupSnapshotsTest-759127538 None] Group tempest-GroupSnapshotsTest-Group-1659672195: created successfully Apr 21 20:57:54 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-86df068d-1662-47a5-b90b-621a424dd34f tempest-GroupSnapshotsTest-759127538 None] Create group completed successfully. Apr 21 20:57:54 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.506s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:54 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:54 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-a5899032-e3c4-408d-8574-ab9b7e096381 tempest-GroupSnapshotsTest-759127538 None] Delete group completed successfully. Apr 21 20:57:54 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7d638443-5308-454f-bcdb-6f1c32605035 tempest-CreateVolumesFromImageTest-529775158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fe49ad19-fde9-4b2f-be0b-78dd218f9f27" returned: 0 in 0.507s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7d638443-5308-454f-bcdb-6f1c32605035 tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fe49ad19-fde9-4b2f-be0b-78dd218f9f27 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:54 devstack sudo[88948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fe49ad19-fde9-4b2f-be0b-78dd218f9f27 Apr 21 20:57:54 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:55 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7d638443-5308-454f-bcdb-6f1c32605035 tempest-CreateVolumesFromImageTest-529775158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-fe49ad19-fde9-4b2f-be0b-78dd218f9f27" returned: 0 in 0.381s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7d638443-5308-454f-bcdb-6f1c32605035 tempest-CreateVolumesFromImageTest-529775158 None] Lock "cinder-quobyte-fe49ad19-fde9-4b2f-be0b-78dd218f9f27" released by "delete_volume" :: held 0.920s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-7d638443-5308-454f-bcdb-6f1c32605035 tempest-CreateVolumesFromImageTest-529775158 None] Created reservations ['36a6345a-2ad8-442f-8945-8e6ef06fc08e', 'ec0c70c6-a975-426d-9b0a-37c5e2673474', '9c440810-6bc5-44a4-a596-74b92843072a', 'c8d20923-fac1-4917-a58a-e4d5ac08f23b'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7d638443-5308-454f-bcdb-6f1c32605035 tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7d638443-5308-454f-bcdb-6f1c32605035 tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7d638443-5308-454f-bcdb-6f1c32605035 tempest-CreateVolumesFromImageTest-529775158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7d638443-5308-454f-bcdb-6f1c32605035 tempest-CreateVolumesFromImageTest-529775158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7d638443-5308-454f-bcdb-6f1c32605035 tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7d638443-5308-454f-bcdb-6f1c32605035 tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:55 devstack sudo[88951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:57:55 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-baa3abc3-41b2-464f-9169-e225348d909e tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "cinder-90f060b2-2ca3-4b51-8606-a943e7be86cc-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-baa3abc3-41b2-464f-9169-e225348d909e tempest-CreateVolumesFromImageTest-529775158 None] Lock "cinder-90f060b2-2ca3-4b51-8606-a943e7be86cc-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-baa3abc3-41b2-464f-9169-e225348d909e tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "cinder-quobyte-90f060b2-2ca3-4b51-8606-a943e7be86cc" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-baa3abc3-41b2-464f-9169-e225348d909e tempest-CreateVolumesFromImageTest-529775158 None] Lock "cinder-quobyte-90f060b2-2ca3-4b51-8606-a943e7be86cc" acquired by "delete_volume" :: waited 0.017s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9316e3-a642-4f7c-aea0-2123c6f5567f]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-baa3abc3-41b2-464f-9169-e225348d909e tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-90f060b2-2ca3-4b51-8606-a943e7be86cc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:55 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-90f060b2-2ca3-4b51-8606-a943e7be86cc Apr 21 20:57:55 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:55 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7d638443-5308-454f-bcdb-6f1c32605035 tempest-CreateVolumesFromImageTest-529775158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.439s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-7d638443-5308-454f-bcdb-6f1c32605035 tempest-CreateVolumesFromImageTest-529775158 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:55 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-7d638443-5308-454f-bcdb-6f1c32605035 tempest-CreateVolumesFromImageTest-529775158 None] Deleted volume successfully. Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7d638443-5308-454f-bcdb-6f1c32605035 tempest-CreateVolumesFromImageTest-529775158 None] Lock "cinder-fe49ad19-fde9-4b2f-be0b-78dd218f9f27-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Flow 'volume_create_manager' (03593cbe-7970-49c9-ba5f-35a18ae6f504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e59222e-8a1f-41ae-9987-b50832114b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e59222e-8a1f-41ae-9987-b50832114b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-748119424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f868fe9-ad2c-40f3-872b-23d39f2020c1,host='devstack@QuobyteHD#QuobyteHD',id=f0f48839-3135-4510-8b21-53a5813c1b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92d06595be084c358cb2dcbbb6d9916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:56Z,use_quota=True,user_id='c095ce2da4ad4d169b5e9613d5cd56d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66040655-bbb2-4636-b8b6-501bba47ab46),volume_type_id=66040655-bbb2-4636-b8b6-501bba47ab46)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c958c87c-3ac5-43b3-b1fd-cb4544debfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c958c87c-3ac5-43b3-b1fd-cb4544debfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aebaac7-e278-4ad2-b93c-5543fef2be3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aebaac7-e278-4ad2-b93c-5543fef2be3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0f48839-3135-4510-8b21-53a5813c1b21', 'volume_name': 'volume-f0f48839-3135-4510-8b21-53a5813c1b21', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e327c8b-69a0-4781-93d3-d231807a70aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e327c8b-69a0-4781-93d3-d231807a70aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f08e68-77cf-41cf-a658-4948fa73d336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:55 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:55 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Volume f0f48839-3135-4510-8b21-53a5813c1b21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0f48839-3135-4510-8b21-53a5813c1b21', 'volume_size': 1} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4f868fe9-ad2c-40f3-872b-23d39f2020c1,created_at=2026-04-21T18:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-748119424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f868fe9-ad2c-40f3-872b-23d39f2020c1,host='devstack@QuobyteHD#QuobyteHD',id=f0f48839-3135-4510-8b21-53a5813c1b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92d06595be084c358cb2dcbbb6d9916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:56Z,use_quota=True,user_id='c095ce2da4ad4d169b5e9613d5cd56d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66040655-bbb2-4636-b8b6-501bba47ab46),volume_type_id=66040655-bbb2-4636-b8b6-501bba47ab46)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Creating volume f0f48839-3135-4510-8b21-53a5813c1b21 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:55 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-baa3abc3-41b2-464f-9169-e225348d909e tempest-CreateVolumesFromImageTest-529775158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-90f060b2-2ca3-4b51-8606-a943e7be86cc" returned: 0 in 0.529s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-baa3abc3-41b2-464f-9169-e225348d909e tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-90f060b2-2ca3-4b51-8606-a943e7be86cc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:55 devstack sudo[88959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21 1073741824 Apr 21 20:57:55 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:55 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-90f060b2-2ca3-4b51-8606-a943e7be86cc Apr 21 20:57:55 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:56 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-baa3abc3-41b2-464f-9169-e225348d909e tempest-CreateVolumesFromImageTest-529775158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-90f060b2-2ca3-4b51-8606-a943e7be86cc" returned: 0 in 0.408s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-baa3abc3-41b2-464f-9169-e225348d909e tempest-CreateVolumesFromImageTest-529775158 None] Lock "cinder-quobyte-90f060b2-2ca3-4b51-8606-a943e7be86cc" released by "delete_volume" :: held 0.958s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-baa3abc3-41b2-464f-9169-e225348d909e tempest-CreateVolumesFromImageTest-529775158 None] Created reservations ['2ba83b8b-2cf0-449e-901a-72bc102988ad', '5ab626e1-b764-4e4f-a222-fa604382a600', '669a566e-8709-4998-9ef2-7008b1fdbf1e', '025f5221-9a4f-46b6-bf3e-5b0699a92271'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:56 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21 1073741824" returned: 0 in 0.517s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-baa3abc3-41b2-464f-9169-e225348d909e tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-baa3abc3-41b2-464f-9169-e225348d909e tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-baa3abc3-41b2-464f-9169-e225348d909e tempest-CreateVolumesFromImageTest-529775158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-baa3abc3-41b2-464f-9169-e225348d909e tempest-CreateVolumesFromImageTest-529775158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-baa3abc3-41b2-464f-9169-e225348d909e tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-baa3abc3-41b2-464f-9169-e225348d909e tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:56 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:57:56 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5b656f70-798f-45e2-87e2-ec3b3a7e4a16 tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "cinder-56d8f470-4b2d-42df-8e99-aaf615ba28bd-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5b656f70-798f-45e2-87e2-ec3b3a7e4a16 tempest-CreateVolumesFromImageTest-529775158 None] Lock "cinder-56d8f470-4b2d-42df-8e99-aaf615ba28bd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:56 devstack sudo[89003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21 Apr 21 20:57:56 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5b656f70-798f-45e2-87e2-ec3b3a7e4a16 tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "cinder-quobyte-56d8f470-4b2d-42df-8e99-aaf615ba28bd" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5b656f70-798f-45e2-87e2-ec3b3a7e4a16 tempest-CreateVolumesFromImageTest-529775158 None] Lock "cinder-quobyte-56d8f470-4b2d-42df-8e99-aaf615ba28bd" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[709cce85-2f4d-4544-b6fd-b99a45b01481]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5b656f70-798f-45e2-87e2-ec3b3a7e4a16 tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-56d8f470-4b2d-42df-8e99-aaf615ba28bd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:56 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-56d8f470-4b2d-42df-8e99-aaf615ba28bd Apr 21 20:57:56 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:56 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-baa3abc3-41b2-464f-9169-e225348d909e tempest-CreateVolumesFromImageTest-529775158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.440s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-baa3abc3-41b2-464f-9169-e225348d909e tempest-CreateVolumesFromImageTest-529775158 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:56 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-baa3abc3-41b2-464f-9169-e225348d909e tempest-CreateVolumesFromImageTest-529775158 None] Deleted volume successfully. Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-baa3abc3-41b2-464f-9169-e225348d909e tempest-CreateVolumesFromImageTest-529775158 None] Lock "cinder-90f060b2-2ca3-4b51-8606-a943e7be86cc-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:56 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21" returned: 0 in 0.441s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f08e68-77cf-41cf-a658-4948fa73d336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f48839-3135-4510-8b21-53a5813c1b21', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9202ed66-fb95-4ce3-96e7-04b10a1d20e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:56 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Volume volume-f0f48839-3135-4510-8b21-53a5813c1b21 (f0f48839-3135-4510-8b21-53a5813c1b21): created successfully Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9202ed66-fb95-4ce3-96e7-04b10a1d20e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Flow 'volume_create_manager' (03593cbe-7970-49c9-ba5f-35a18ae6f504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:56 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-6a655f21-3692-429b-9f55-c5a96727008a tempest-GroupSnapshotsTest-759127538 None] Created volume successfully. Apr 21 20:57:57 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5b656f70-798f-45e2-87e2-ec3b3a7e4a16 tempest-CreateVolumesFromImageTest-529775158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-56d8f470-4b2d-42df-8e99-aaf615ba28bd" returned: 0 in 0.494s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5b656f70-798f-45e2-87e2-ec3b3a7e4a16 tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-56d8f470-4b2d-42df-8e99-aaf615ba28bd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:57 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-56d8f470-4b2d-42df-8e99-aaf615ba28bd Apr 21 20:57:57 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:57 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5b656f70-798f-45e2-87e2-ec3b3a7e4a16 tempest-CreateVolumesFromImageTest-529775158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-56d8f470-4b2d-42df-8e99-aaf615ba28bd" returned: 0 in 0.387s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:57 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5b656f70-798f-45e2-87e2-ec3b3a7e4a16 tempest-CreateVolumesFromImageTest-529775158 None] Lock "cinder-quobyte-56d8f470-4b2d-42df-8e99-aaf615ba28bd" released by "delete_volume" :: held 0.901s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:57 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-5b656f70-798f-45e2-87e2-ec3b3a7e4a16 tempest-CreateVolumesFromImageTest-529775158 None] Created reservations ['965e9ac1-1a00-4c2b-8841-a07a09817786', 'efd09da5-49e9-4928-809c-4c41b87db6eb', '644e2568-83e4-44cb-8121-6d1ba3004125', 'c1bbe14f-f806-4df6-9955-794773f28e9b'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5b656f70-798f-45e2-87e2-ec3b3a7e4a16 tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5b656f70-798f-45e2-87e2-ec3b3a7e4a16 tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:57 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5b656f70-798f-45e2-87e2-ec3b3a7e4a16 tempest-CreateVolumesFromImageTest-529775158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:57 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5b656f70-798f-45e2-87e2-ec3b3a7e4a16 tempest-CreateVolumesFromImageTest-529775158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5b656f70-798f-45e2-87e2-ec3b3a7e4a16 tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5b656f70-798f-45e2-87e2-ec3b3a7e4a16 tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:57 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:57:57 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:57 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c3649bed-42ae-4241-be36-863ae6a56387 tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "cinder-9a0f610b-9508-4944-b7e7-a6495248a028-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:57 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c3649bed-42ae-4241-be36-863ae6a56387 tempest-CreateVolumesFromImageTest-529775158 None] Lock "cinder-9a0f610b-9508-4944-b7e7-a6495248a028-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:57 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c3649bed-42ae-4241-be36-863ae6a56387 tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "cinder-quobyte-9a0f610b-9508-4944-b7e7-a6495248a028" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:57 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c3649bed-42ae-4241-be36-863ae6a56387 tempest-CreateVolumesFromImageTest-529775158 None] Lock "cinder-quobyte-9a0f610b-9508-4944-b7e7-a6495248a028" acquired by "delete_volume" :: waited 0.006s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:57 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbfb04c-fd40-43af-939a-57059efc7dbc]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c3649bed-42ae-4241-be36-863ae6a56387 tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a0f610b-9508-4944-b7e7-a6495248a028 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:57 devstack sudo[89017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a0f610b-9508-4944-b7e7-a6495248a028 Apr 21 20:57:57 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:57 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5b656f70-798f-45e2-87e2-ec3b3a7e4a16 tempest-CreateVolumesFromImageTest-529775158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.434s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:57 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-5b656f70-798f-45e2-87e2-ec3b3a7e4a16 tempest-CreateVolumesFromImageTest-529775158 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:57 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-5b656f70-798f-45e2-87e2-ec3b3a7e4a16 tempest-CreateVolumesFromImageTest-529775158 None] Deleted volume successfully. Apr 21 20:57:57 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5b656f70-798f-45e2-87e2-ec3b3a7e4a16 tempest-CreateVolumesFromImageTest-529775158 None] Lock "cinder-56d8f470-4b2d-42df-8e99-aaf615ba28bd-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:58 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-5656e0d3-336b-4142-9dcd-f54d73bc6de2 tempest-GroupSnapshotsTest-759127538 None] GroupSnapshot 42cb7ed0-c390-44ed-9e5f-65b5153e5dbf: creating. Apr 21 20:57:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5656e0d3-336b-4142-9dcd-f54d73bc6de2 tempest-GroupSnapshotsTest-759127538 None] Group snapshot 42cb7ed0-c390-44ed-9e5f-65b5153e5dbf: creating. {{(pid=81957) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 21 20:57:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5656e0d3-336b-4142-9dcd-f54d73bc6de2 tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5656e0d3-336b-4142-9dcd-f54d73bc6de2 tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:58 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c3649bed-42ae-4241-be36-863ae6a56387 tempest-CreateVolumesFromImageTest-529775158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a0f610b-9508-4944-b7e7-a6495248a028" returned: 0 in 0.507s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-5656e0d3-336b-4142-9dcd-f54d73bc6de2 tempest-GroupSnapshotsTest-759127538 None] Creating offline snapshot 9c18db88-1062-4fe7-a07e-05c9a4cc4dc7 of volume f0f48839-3135-4510-8b21-53a5813c1b21 {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:57:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c3649bed-42ae-4241-be36-863ae6a56387 tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a0f610b-9508-4944-b7e7-a6495248a028 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:58 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f34469-8b0e-456c-92ba-cbdba2fe71ab]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5656e0d3-336b-4142-9dcd-f54d73bc6de2 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:58 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a0f610b-9508-4944-b7e7-a6495248a028 Apr 21 20:57:58 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:58 devstack sudo[89024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21 Apr 21 20:57:58 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:58 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c3649bed-42ae-4241-be36-863ae6a56387 tempest-CreateVolumesFromImageTest-529775158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a0f610b-9508-4944-b7e7-a6495248a028" returned: 0 in 0.391s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c3649bed-42ae-4241-be36-863ae6a56387 tempest-CreateVolumesFromImageTest-529775158 None] Lock "cinder-quobyte-9a0f610b-9508-4944-b7e7-a6495248a028" released by "delete_volume" :: held 0.932s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:58 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-c3649bed-42ae-4241-be36-863ae6a56387 tempest-CreateVolumesFromImageTest-529775158 None] Created reservations ['f45606bd-63bf-4fde-93b2-2302af767cb9', 'fa5b73ba-ad53-4d2a-9276-0d334e0a1f77', '86dd78e6-b1e2-4f19-961a-a852c86ab42c', 'fe1e7522-7b5a-4712-a61d-2b8001cab280'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:58 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5656e0d3-336b-4142-9dcd-f54d73bc6de2 tempest-GroupSnapshotsTest-759127538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21" returned: 0 in 0.450s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5656e0d3-336b-4142-9dcd-f54d73bc6de2 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.9c18db88-1062-4fe7-a07e-05c9a4cc4dc7 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c3649bed-42ae-4241-be36-863ae6a56387 tempest-CreateVolumesFromImageTest-529775158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c3649bed-42ae-4241-be36-863ae6a56387 tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c3649bed-42ae-4241-be36-863ae6a56387 tempest-CreateVolumesFromImageTest-529775158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c3649bed-42ae-4241-be36-863ae6a56387 tempest-CreateVolumesFromImageTest-529775158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c3649bed-42ae-4241-be36-863ae6a56387 tempest-CreateVolumesFromImageTest-529775158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c3649bed-42ae-4241-be36-863ae6a56387 tempest-CreateVolumesFromImageTest-529775158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:58 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.9c18db88-1062-4fe7-a07e-05c9a4cc4dc7 1G Apr 21 20:57:58 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:58 devstack sudo[89032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:57:58 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:59 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c3649bed-42ae-4241-be36-863ae6a56387 tempest-CreateVolumesFromImageTest-529775158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.489s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:59 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-c3649bed-42ae-4241-be36-863ae6a56387 tempest-CreateVolumesFromImageTest-529775158 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:59 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-c3649bed-42ae-4241-be36-863ae6a56387 tempest-CreateVolumesFromImageTest-529775158 None] Deleted volume successfully. Apr 21 20:57:59 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c3649bed-42ae-4241-be36-863ae6a56387 tempest-CreateVolumesFromImageTest-529775158 None] Lock "cinder-9a0f610b-9508-4944-b7e7-a6495248a028-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:59 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5656e0d3-336b-4142-9dcd-f54d73bc6de2 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.9c18db88-1062-4fe7-a07e-05c9a4cc4dc7 1G" returned: 0 in 0.529s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5656e0d3-336b-4142-9dcd-f54d73bc6de2 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0f48839-3135-4510-8b21-53a5813c1b21 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.9c18db88-1062-4fe7-a07e-05c9a4cc4dc7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:59 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0f48839-3135-4510-8b21-53a5813c1b21 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.9c18db88-1062-4fe7-a07e-05c9a4cc4dc7 Apr 21 20:57:59 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:59 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5656e0d3-336b-4142-9dcd-f54d73bc6de2 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0f48839-3135-4510-8b21-53a5813c1b21 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.9c18db88-1062-4fe7-a07e-05c9a4cc4dc7" returned: 0 in 0.446s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:59 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-5656e0d3-336b-4142-9dcd-f54d73bc6de2 tempest-GroupSnapshotsTest-759127538 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.9c18db88-1062-4fe7-a07e-05c9a4cc4dc7 is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:57:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5656e0d3-336b-4142-9dcd-f54d73bc6de2 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.9c18db88-1062-4fe7-a07e-05c9a4cc4dc7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:59 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.9c18db88-1062-4fe7-a07e-05c9a4cc4dc7 Apr 21 20:57:59 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:59 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5656e0d3-336b-4142-9dcd-f54d73bc6de2 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.9c18db88-1062-4fe7-a07e-05c9a4cc4dc7" returned: 0 in 0.431s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5656e0d3-336b-4142-9dcd-f54d73bc6de2 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:00 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.info Apr 21 20:58:00 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Flow 'volume_create_manager' (4e149169-32c4-4d99-a947-b05ac0282724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe62cbd0-5584-41cf-b8d8-35ab1dfaf2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe62cbd0-5584-41cf-b8d8-35ab1dfaf2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1370976269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ab160ae27c42e09d293d3a308ce985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:00Z,use_quota=True,user_id='06da3c2fcf014edea250cd347850d7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da877a58-4103-4edf-88e5-d255e8d8bf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da877a58-4103-4edf-88e5-d255e8d8bf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69071bd-ac0e-47b5-a5ed-0df348b9eb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69071bd-ac0e-47b5-a5ed-0df348b9eb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0', 'volume_name': 'volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8176e2c-35b7-4b57-8866-ff1a9dd98690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8176e2c-35b7-4b57-8866-ff1a9dd98690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (948f8d21-ba25-4a61-a678-7b042e559051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:00 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Volume 93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0', 'volume_size': 1} Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:00 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5656e0d3-336b-4142-9dcd-f54d73bc6de2 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.info" returned: 0 in 0.449s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:00 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-5656e0d3-336b-4142-9dcd-f54d73bc6de2 tempest-GroupSnapshotsTest-759127538 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5656e0d3-336b-4142-9dcd-f54d73bc6de2 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:00 devstack sudo[89051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.info Apr 21 20:58:00 devstack sudo[89051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:00 devstack sudo[89051]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5656e0d3-336b-4142-9dcd-f54d73bc6de2 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.info" returned: 0 in 0.380s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5656e0d3-336b-4142-9dcd-f54d73bc6de2 tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.741s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.427s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1370976269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ab160ae27c42e09d293d3a308ce985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:00Z,use_quota=True,user_id='06da3c2fcf014edea250cd347850d7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Creating volume 93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:00 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:58:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:00 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0 1073741824 Apr 21 20:58:00 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:00 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-5656e0d3-336b-4142-9dcd-f54d73bc6de2 tempest-GroupSnapshotsTest-759127538 None] group_snapshot 42cb7ed0-c390-44ed-9e5f-65b5153e5dbf: created successfully Apr 21 20:58:01 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-1c64d743-0e8a-479c-8f75-1fbcdd134eb5 tempest-GroupSnapshotsTest-759127538 None] group_snapshot 42cb7ed0-c390-44ed-9e5f-65b5153e5dbf: deleting Apr 21 20:58:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-1c64d743-0e8a-479c-8f75-1fbcdd134eb5 tempest-GroupSnapshotsTest-759127538 None] group_snapshot 42cb7ed0-c390-44ed-9e5f-65b5153e5dbf: deleting {{(pid=81957) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 21 20:58:01 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1c64d743-0e8a-479c-8f75-1fbcdd134eb5 tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "cinder-quobyte-f0f48839-3135-4510-8b21-53a5813c1b21" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:01 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1c64d743-0e8a-479c-8f75-1fbcdd134eb5 tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-f0f48839-3135-4510-8b21-53a5813c1b21" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:01 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1c64d743-0e8a-479c-8f75-1fbcdd134eb5 tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "cinder-quobyte-9c18db88-1062-4fe7-a07e-05c9a4cc4dc7" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:01 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1c64d743-0e8a-479c-8f75-1fbcdd134eb5 tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-9c18db88-1062-4fe7-a07e-05c9a4cc4dc7" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-1c64d743-0e8a-479c-8f75-1fbcdd134eb5 tempest-GroupSnapshotsTest-759127538 None] Deleting offline snapshot 9c18db88-1062-4fe7-a07e-05c9a4cc4dc7 of volume f0f48839-3135-4510-8b21-53a5813c1b21 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:58:01 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-1c64d743-0e8a-479c-8f75-1fbcdd134eb5 tempest-GroupSnapshotsTest-759127538 None] snapshot_file for this snap is: volume-f0f48839-3135-4510-8b21-53a5813c1b21.9c18db88-1062-4fe7-a07e-05c9a4cc4dc7 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:58:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0 1073741824" returned: 0 in 0.528s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:01 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc9073d-4153-4801-a11f-9ec5efde32d6]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1c64d743-0e8a-479c-8f75-1fbcdd134eb5 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.9c18db88-1062-4fe7-a07e-05c9a4cc4dc7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:01 devstack sudo[89061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0 Apr 21 20:58:01 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:01 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.9c18db88-1062-4fe7-a07e-05c9a4cc4dc7 Apr 21 20:58:01 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:01 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0" returned: 0 in 0.409s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (948f8d21-ba25-4a61-a678-7b042e559051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a600baa-53b7-46b2-8710-c8069e15cdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:01 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1c64d743-0e8a-479c-8f75-1fbcdd134eb5 tempest-GroupSnapshotsTest-759127538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.9c18db88-1062-4fe7-a07e-05c9a4cc4dc7" returned: 0 in 0.460s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-1c64d743-0e8a-479c-8f75-1fbcdd134eb5 tempest-GroupSnapshotsTest-759127538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0f48839-3135-4510-8b21-53a5813c1b21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:58:01 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae5804a-0991-410c-a4f2-2d00989670c3]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1c64d743-0e8a-479c-8f75-1fbcdd134eb5 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:01 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Volume volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0 (93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0): created successfully Apr 21 20:58:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a600baa-53b7-46b2-8710-c8069e15cdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Flow 'volume_create_manager' (4e149169-32c4-4d99-a947-b05ac0282724) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:01 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-c7a580ca-1075-4b08-a3c9-35ef76b9751c tempest-CreateVolumesFromSnapshotTest-1570523949 None] Created volume successfully. Apr 21 20:58:01 devstack sudo[89068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21 Apr 21 20:58:01 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:02 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1c64d743-0e8a-479c-8f75-1fbcdd134eb5 tempest-GroupSnapshotsTest-759127538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21" returned: 0 in 0.434s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1c64d743-0e8a-479c-8f75-1fbcdd134eb5 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.9c18db88-1062-4fe7-a07e-05c9a4cc4dc7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:02 devstack sudo[89073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.9c18db88-1062-4fe7-a07e-05c9a4cc4dc7 Apr 21 20:58:02 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e0752b2c-f5c3-4370-9e53-a7864008ca47 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e0752b2c-f5c3-4370-9e53-a7864008ca47 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:02 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-e0752b2c-f5c3-4370-9e53-a7864008ca47 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Creating offline snapshot 566f4ad6-5e99-4153-83b9-1f77c035f615 of volume 93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0 {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:58:02 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d22693f-1513-4188-a3f1-21ea39c25fe8]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e0752b2c-f5c3-4370-9e53-a7864008ca47 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:02 devstack sudo[89075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0 Apr 21 20:58:02 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:02 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1c64d743-0e8a-479c-8f75-1fbcdd134eb5 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.9c18db88-1062-4fe7-a07e-05c9a4cc4dc7" returned: 0 in 0.466s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1c64d743-0e8a-479c-8f75-1fbcdd134eb5 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.9c18db88-1062-4fe7-a07e-05c9a4cc4dc7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:02 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.9c18db88-1062-4fe7-a07e-05c9a4cc4dc7 Apr 21 20:58:02 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:03 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e0752b2c-f5c3-4370-9e53-a7864008ca47 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0" returned: 0 in 0.465s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e0752b2c-f5c3-4370-9e53-a7864008ca47 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.566f4ad6-5e99-4153-83b9-1f77c035f615 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:03 devstack sudo[89085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.566f4ad6-5e99-4153-83b9-1f77c035f615 1G Apr 21 20:58:03 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:03 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1c64d743-0e8a-479c-8f75-1fbcdd134eb5 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21.9c18db88-1062-4fe7-a07e-05c9a4cc4dc7" returned: 0 in 0.404s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1c64d743-0e8a-479c-8f75-1fbcdd134eb5 tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-9c18db88-1062-4fe7-a07e-05c9a4cc4dc7" released by "_delete_snapshot" :: held 1.825s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1c64d743-0e8a-479c-8f75-1fbcdd134eb5 tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-f0f48839-3135-4510-8b21-53a5813c1b21" released by "delete_snapshot" :: held 1.838s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:03 devstack cinder-volume[81957]: WARNING cinder.quota [None req-1c64d743-0e8a-479c-8f75-1fbcdd134eb5 tempest-GroupSnapshotsTest-759127538 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2104406158 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2104406158, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:58:03 devstack cinder-volume[81957]: WARNING cinder.quota [None req-1c64d743-0e8a-479c-8f75-1fbcdd134eb5 tempest-GroupSnapshotsTest-759127538 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2104406158 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2104406158, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:58:03 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-1c64d743-0e8a-479c-8f75-1fbcdd134eb5 tempest-GroupSnapshotsTest-759127538 None] Created reservations ['6a2f4186-e477-4521-bc4c-074340fd61c9', 'ed4c3c39-7373-4131-93de-632a71f35696', '4f4e29f8-a239-4ad6-8061-8f0629ad36ce', 'b93332a2-1083-4248-806c-3fb64baafcb6'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:03 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-1c64d743-0e8a-479c-8f75-1fbcdd134eb5 tempest-GroupSnapshotsTest-759127538 None] group_snapshot 42cb7ed0-c390-44ed-9e5f-65b5153e5dbf: deleted successfully Apr 21 20:58:03 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e0752b2c-f5c3-4370-9e53-a7864008ca47 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.566f4ad6-5e99-4153-83b9-1f77c035f615 1G" returned: 0 in 0.488s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e0752b2c-f5c3-4370-9e53-a7864008ca47 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.566f4ad6-5e99-4153-83b9-1f77c035f615 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:03 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.566f4ad6-5e99-4153-83b9-1f77c035f615 Apr 21 20:58:03 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-07696e2b-bacc-45a8-823a-ff7f488af3d6 tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "cinder-quobyte-f0f48839-3135-4510-8b21-53a5813c1b21" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-07696e2b-bacc-45a8-823a-ff7f488af3d6 tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-f0f48839-3135-4510-8b21-53a5813c1b21" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:03 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34b4aa7-2f3e-42cc-8b3a-28e632c5e442]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-07696e2b-bacc-45a8-823a-ff7f488af3d6 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:03 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21 Apr 21 20:58:03 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:04 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e0752b2c-f5c3-4370-9e53-a7864008ca47 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.566f4ad6-5e99-4153-83b9-1f77c035f615" returned: 0 in 0.469s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:04 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-e0752b2c-f5c3-4370-9e53-a7864008ca47 tempest-CreateVolumesFromSnapshotTest-1570523949 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.566f4ad6-5e99-4153-83b9-1f77c035f615 is being set with open permissions: ugo+rw Apr 21 20:58:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e0752b2c-f5c3-4370-9e53-a7864008ca47 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.566f4ad6-5e99-4153-83b9-1f77c035f615 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:04 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.566f4ad6-5e99-4153-83b9-1f77c035f615 Apr 21 20:58:04 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:04 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-07696e2b-bacc-45a8-823a-ff7f488af3d6 tempest-GroupSnapshotsTest-759127538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21" returned: 0 in 0.470s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-07696e2b-bacc-45a8-823a-ff7f488af3d6 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:04 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21 Apr 21 20:58:04 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:04 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e0752b2c-f5c3-4370-9e53-a7864008ca47 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.566f4ad6-5e99-4153-83b9-1f77c035f615" returned: 0 in 0.409s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e0752b2c-f5c3-4370-9e53-a7864008ca47 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:04 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.info Apr 21 20:58:04 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:04 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-07696e2b-bacc-45a8-823a-ff7f488af3d6 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f0f48839-3135-4510-8b21-53a5813c1b21" returned: 0 in 0.404s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-07696e2b-bacc-45a8-823a-ff7f488af3d6 tempest-GroupSnapshotsTest-759127538 None] Lock "cinder-quobyte-f0f48839-3135-4510-8b21-53a5813c1b21" released by "delete_volume" :: held 0.910s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:04 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-07696e2b-bacc-45a8-823a-ff7f488af3d6 tempest-GroupSnapshotsTest-759127538 None] Created reservations ['e90f0c17-f891-4fc8-89d3-ee2eb969f7d9'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:04 devstack cinder-volume[81957]: WARNING cinder.quota [None req-07696e2b-bacc-45a8-823a-ff7f488af3d6 tempest-GroupSnapshotsTest-759127538 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2104406158 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2104406158, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:58:04 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-07696e2b-bacc-45a8-823a-ff7f488af3d6 tempest-GroupSnapshotsTest-759127538 None] Created reservations ['b81ab06d-00a1-4805-a956-c6973d2c8b4b', 'a6084ce5-1c4e-4783-8c3c-ba2e445caa63', '29e40c7b-58fa-406c-ac8a-33b031b8b65c', 'eeedcc5f-50e7-43f8-98f6-c10cb15885a4'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-07696e2b-bacc-45a8-823a-ff7f488af3d6 tempest-GroupSnapshotsTest-759127538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-07696e2b-bacc-45a8-823a-ff7f488af3d6 tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-07696e2b-bacc-45a8-823a-ff7f488af3d6 tempest-GroupSnapshotsTest-759127538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-07696e2b-bacc-45a8-823a-ff7f488af3d6 tempest-GroupSnapshotsTest-759127538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-07696e2b-bacc-45a8-823a-ff7f488af3d6 tempest-GroupSnapshotsTest-759127538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-07696e2b-bacc-45a8-823a-ff7f488af3d6 tempest-GroupSnapshotsTest-759127538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:04 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:58:04 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:04 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e0752b2c-f5c3-4370-9e53-a7864008ca47 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.info" returned: 0 in 0.456s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:04 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-e0752b2c-f5c3-4370-9e53-a7864008ca47 tempest-CreateVolumesFromSnapshotTest-1570523949 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.info is being set with open permissions: ugo+rw Apr 21 20:58:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e0752b2c-f5c3-4370-9e53-a7864008ca47 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:04 devstack sudo[89112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.info Apr 21 20:58:04 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:05 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-07696e2b-bacc-45a8-823a-ff7f488af3d6 tempest-GroupSnapshotsTest-759127538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.463s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:05 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-07696e2b-bacc-45a8-823a-ff7f488af3d6 tempest-GroupSnapshotsTest-759127538 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:05 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-07696e2b-bacc-45a8-823a-ff7f488af3d6 tempest-GroupSnapshotsTest-759127538 None] Delete group completed successfully. Apr 21 20:58:05 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e0752b2c-f5c3-4370-9e53-a7864008ca47 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.info" returned: 0 in 0.473s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e0752b2c-f5c3-4370-9e53-a7864008ca47 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.812s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:05 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-e0752b2c-f5c3-4370-9e53-a7864008ca47 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Create snapshot completed successfully Apr 21 20:58:05 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:05 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Flow 'volume_create_manager' (4a7e4941-d519-4c9c-a091-4148a7f83276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:05 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d95cdcc-a88b-4776-a9a7-bc531b729d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d95cdcc-a88b-4776-a9a7-bc531b729d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1991551204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63fdf5a9-469c-44cd-817f-0b8f35860cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ab160ae27c42e09d293d3a308ce985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:06Z,use_quota=True,user_id='06da3c2fcf014edea250cd347850d7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29364db8-ea45-4ab6-aa8e-58f256041623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29364db8-ea45-4ab6-aa8e-58f256041623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45df96fe-4408-4f1a-87be-d3d0ac16beb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45df96fe-4408-4f1a-87be-d3d0ac16beb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63fdf5a9-469c-44cd-817f-0b8f35860cc4', 'volume_name': 'volume-63fdf5a9-469c-44cd-817f-0b8f35860cc4', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985aa6cb-4fa6-43d2-8999-a2f83ec52726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985aa6cb-4fa6-43d2-8999-a2f83ec52726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4369da8b-3220-42cc-bd20-6f202ef331c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Volume 63fdf5a9-469c-44cd-817f-0b8f35860cc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63fdf5a9-469c-44cd-817f-0b8f35860cc4', 'volume_size': 1} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1991551204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63fdf5a9-469c-44cd-817f-0b8f35860cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ab160ae27c42e09d293d3a308ce985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:06Z,use_quota=True,user_id='06da3c2fcf014edea250cd347850d7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Creating volume 63fdf5a9-469c-44cd-817f-0b8f35860cc4 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:06 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-63fdf5a9-469c-44cd-817f-0b8f35860cc4 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:06 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-63fdf5a9-469c-44cd-817f-0b8f35860cc4 1073741824 Apr 21 20:58:06 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Flow 'volume_create_manager' (18abdb7b-1f19-49c8-9d2c-8755b368c435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62cbd1a3-14b9-4811-a7d9-21dc6ea70d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62cbd1a3-14b9-4811-a7d9-21dc6ea70d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2027059098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=248334eb-7713-4d10-a914-52abea43406e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ab160ae27c42e09d293d3a308ce985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:06Z,use_quota=True,user_id='06da3c2fcf014edea250cd347850d7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c967593-4d62-4166-b72b-1b8d0a580004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c967593-4d62-4166-b72b-1b8d0a580004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a890d3-70b6-40e8-921a-14782977c845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a890d3-70b6-40e8-921a-14782977c845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '248334eb-7713-4d10-a914-52abea43406e', 'volume_name': 'volume-248334eb-7713-4d10-a914-52abea43406e', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0993b60f-d1c0-443f-8cb6-0643fb258afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0993b60f-d1c0-443f-8cb6-0643fb258afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc6de22c-390a-4378-9757-9482325fa8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Volume 248334eb-7713-4d10-a914-52abea43406e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-248334eb-7713-4d10-a914-52abea43406e', 'volume_size': 1} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Flow 'volume_create_manager' (b43a41e4-7098-4f06-b9a9-6f3665816fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb9634dd-cdfd-41e2-b95e-dbc62d8cf273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb9634dd-cdfd-41e2-b95e-dbc62d8cf273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1689403057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743b54b4-404e-4884-823c-87d1c8873164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ab160ae27c42e09d293d3a308ce985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:06Z,use_quota=True,user_id='06da3c2fcf014edea250cd347850d7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad5259e-24f4-4be9-9f73-eecc402fbb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad5259e-24f4-4be9-9f73-eecc402fbb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc95ed80-6a4d-44a1-9014-032b3c77e34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc95ed80-6a4d-44a1-9014-032b3c77e34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '743b54b4-404e-4884-823c-87d1c8873164', 'volume_name': 'volume-743b54b4-404e-4884-823c-87d1c8873164', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3ecb577-6fb4-471c-9c75-528c87026f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3ecb577-6fb4-471c-9c75-528c87026f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb87e573-2d04-4536-9b4a-548d92f83f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Volume 743b54b4-404e-4884-823c-87d1c8873164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-743b54b4-404e-4884-823c-87d1c8873164', 'volume_size': 1} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Flow 'volume_create_manager' (8d5fa6bc-aa9d-4ace-9fda-ac50a5122136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d10102f-d0a2-482e-9d01-815418b7bb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d10102f-d0a2-482e-9d01-815418b7bb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1538915324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1b26b9-ffed-4077-a346-d19c24681187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ab160ae27c42e09d293d3a308ce985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:07Z,use_quota=True,user_id='06da3c2fcf014edea250cd347850d7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:06 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee84690-18d4-4712-b2ad-7428a02a0343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee84690-18d4-4712-b2ad-7428a02a0343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d707f3-117f-4346-9871-d93ba42e5fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d707f3-117f-4346-9871-d93ba42e5fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e1b26b9-ffed-4077-a346-d19c24681187', 'volume_name': 'volume-9e1b26b9-ffed-4077-a346-d19c24681187', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0057c30-5088-4149-ac4c-e7d07f11d350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0057c30-5088-4149-ac4c-e7d07f11d350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a94a4eda-bcc0-44ef-bb6e-028b5a9d32b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Volume 9e1b26b9-ffed-4077-a346-d19c24681187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e1b26b9-ffed-4077-a346-d19c24681187', 'volume_size': 1} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-63fdf5a9-469c-44cd-817f-0b8f35860cc4 1073741824" returned: 0 in 0.732s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-63fdf5a9-469c-44cd-817f-0b8f35860cc4 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:06 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-63fdf5a9-469c-44cd-817f-0b8f35860cc4 Apr 21 20:58:06 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Flow 'volume_create_manager' (c8d1e9ba-b218-4cfc-9a7f-a5fc4eb851f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81675760-bfd5-42e3-817f-b4d99c58ecde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81675760-bfd5-42e3-817f-b4d99c58ecde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-81827388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0efb39d1-0072-4f93-bd29-d40e8847820f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ab160ae27c42e09d293d3a308ce985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:07Z,use_quota=True,user_id='06da3c2fcf014edea250cd347850d7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84554953-7927-4b88-806c-cb5ad266955c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84554953-7927-4b88-806c-cb5ad266955c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ecf5b1c-e902-4aa8-9c83-1930b780ec35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ecf5b1c-e902-4aa8-9c83-1930b780ec35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0efb39d1-0072-4f93-bd29-d40e8847820f', 'volume_name': 'volume-0efb39d1-0072-4f93-bd29-d40e8847820f', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af44f419-6d68-4de5-b894-3cbde1c94063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af44f419-6d68-4de5-b894-3cbde1c94063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff38794-5669-4bd9-bca9-c90479c2daf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Volume 0efb39d1-0072-4f93-bd29-d40e8847820f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0efb39d1-0072-4f93-bd29-d40e8847820f', 'volume_size': 1} Apr 21 20:58:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:07 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-63fdf5a9-469c-44cd-817f-0b8f35860cc4" returned: 0 in 0.448s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:07 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.954s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:07 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2027059098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=248334eb-7713-4d10-a914-52abea43406e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ab160ae27c42e09d293d3a308ce985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:06Z,use_quota=True,user_id='06da3c2fcf014edea250cd347850d7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:07 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Creating volume 248334eb-7713-4d10-a914-52abea43406e {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:07 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:07 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:07 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:07 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:58:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-248334eb-7713-4d10-a914-52abea43406e 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:07 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4369da8b-3220-42cc-bd20-6f202ef331c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63fdf5a9-469c-44cd-817f-0b8f35860cc4', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:07 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8377105-f4a7-4a77-9406-3bfad6adcf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:07 devstack sudo[89124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-248334eb-7713-4d10-a914-52abea43406e 1073741824 Apr 21 20:58:07 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:07 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Volume volume-63fdf5a9-469c-44cd-817f-0b8f35860cc4 (63fdf5a9-469c-44cd-817f-0b8f35860cc4): created successfully Apr 21 20:58:07 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8377105-f4a7-4a77-9406-3bfad6adcf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:07 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Flow 'volume_create_manager' (4a7e4941-d519-4c9c-a091-4148a7f83276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:07 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-fa75cdea-b36f-4058-b904-48db6dbb79b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Created volume successfully. Apr 21 20:58:07 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-248334eb-7713-4d10-a914-52abea43406e 1073741824" returned: 0 in 0.502s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-248334eb-7713-4d10-a914-52abea43406e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:07 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-248334eb-7713-4d10-a914-52abea43406e Apr 21 20:58:07 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:08 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-248334eb-7713-4d10-a914-52abea43406e" returned: 0 in 0.445s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:08 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.713s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:08 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1689403057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743b54b4-404e-4884-823c-87d1c8873164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ab160ae27c42e09d293d3a308ce985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:06Z,use_quota=True,user_id='06da3c2fcf014edea250cd347850d7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:08 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Creating volume 743b54b4-404e-4884-823c-87d1c8873164 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:08 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:08 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:08 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:08 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:58:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-743b54b4-404e-4884-823c-87d1c8873164 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc6de22c-390a-4378-9757-9482325fa8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-248334eb-7713-4d10-a914-52abea43406e', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f59a4a1-6d38-4c4f-a852-426f08d59fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:08 devstack sudo[89132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-743b54b4-404e-4884-823c-87d1c8873164 1073741824 Apr 21 20:58:08 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:08 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Volume volume-248334eb-7713-4d10-a914-52abea43406e (248334eb-7713-4d10-a914-52abea43406e): created successfully Apr 21 20:58:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f59a4a1-6d38-4c4f-a852-426f08d59fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:08 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Flow 'volume_create_manager' (18abdb7b-1f19-49c8-9d2c-8755b368c435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:08 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-58763d97-1797-4273-94d6-31aaa61ab92d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Created volume successfully. Apr 21 20:58:08 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-743b54b4-404e-4884-823c-87d1c8873164 1073741824" returned: 0 in 0.549s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-743b54b4-404e-4884-823c-87d1c8873164 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:08 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-743b54b4-404e-4884-823c-87d1c8873164 Apr 21 20:58:08 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:09 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-743b54b4-404e-4884-823c-87d1c8873164" returned: 0 in 0.483s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:09 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.521s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:09 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1538915324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1b26b9-ffed-4077-a346-d19c24681187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ab160ae27c42e09d293d3a308ce985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:07Z,use_quota=True,user_id='06da3c2fcf014edea250cd347850d7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:09 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Creating volume 9e1b26b9-ffed-4077-a346-d19c24681187 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:09 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:09 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:09 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:09 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:58:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9e1b26b9-ffed-4077-a346-d19c24681187 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb87e573-2d04-4536-9b4a-548d92f83f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-743b54b4-404e-4884-823c-87d1c8873164', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650affe5-3f04-4f13-9bfd-f69cecf41ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:09 devstack sudo[89141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9e1b26b9-ffed-4077-a346-d19c24681187 1073741824 Apr 21 20:58:09 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:09 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Volume volume-743b54b4-404e-4884-823c-87d1c8873164 (743b54b4-404e-4884-823c-87d1c8873164): created successfully Apr 21 20:58:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650affe5-3f04-4f13-9bfd-f69cecf41ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:09 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Flow 'volume_create_manager' (b43a41e4-7098-4f06-b9a9-6f3665816fa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:09 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-ebc6b659-4004-4b83-9c35-a66fc86333b2 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Created volume successfully. Apr 21 20:58:09 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9e1b26b9-ffed-4077-a346-d19c24681187 1073741824" returned: 0 in 0.500s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9e1b26b9-ffed-4077-a346-d19c24681187 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:09 devstack sudo[89146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9e1b26b9-ffed-4077-a346-d19c24681187 Apr 21 20:58:09 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:10 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9e1b26b9-ffed-4077-a346-d19c24681187" returned: 0 in 0.408s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.267s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-81827388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0efb39d1-0072-4f93-bd29-d40e8847820f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ab160ae27c42e09d293d3a308ce985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:07Z,use_quota=True,user_id='06da3c2fcf014edea250cd347850d7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Creating volume 0efb39d1-0072-4f93-bd29-d40e8847820f {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:10 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:58:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0efb39d1-0072-4f93-bd29-d40e8847820f 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a94a4eda-bcc0-44ef-bb6e-028b5a9d32b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e1b26b9-ffed-4077-a346-d19c24681187', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeba9600-ab1c-4d6e-9335-58af2bd5a48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:10 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0efb39d1-0072-4f93-bd29-d40e8847820f 1073741824 Apr 21 20:58:10 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:10 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Volume volume-9e1b26b9-ffed-4077-a346-d19c24681187 (9e1b26b9-ffed-4077-a346-d19c24681187): created successfully Apr 21 20:58:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeba9600-ab1c-4d6e-9335-58af2bd5a48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Flow 'volume_create_manager' (8d5fa6bc-aa9d-4ace-9fda-ac50a5122136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:10 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-65265ab7-e2e1-4eda-8956-2493c6119b20 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Created volume successfully. Apr 21 20:58:10 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0efb39d1-0072-4f93-bd29-d40e8847820f 1073741824" returned: 0 in 0.525s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0efb39d1-0072-4f93-bd29-d40e8847820f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:10 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0efb39d1-0072-4f93-bd29-d40e8847820f Apr 21 20:58:10 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:11 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0efb39d1-0072-4f93-bd29-d40e8847820f" returned: 0 in 0.448s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:11 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff38794-5669-4bd9-bca9-c90479c2daf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0efb39d1-0072-4f93-bd29-d40e8847820f', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a76b8a-f09c-405f-9f20-c9638f8e1c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:11 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Volume volume-0efb39d1-0072-4f93-bd29-d40e8847820f (0efb39d1-0072-4f93-bd29-d40e8847820f): created successfully Apr 21 20:58:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a76b8a-f09c-405f-9f20-c9638f8e1c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Flow 'volume_create_manager' (c8d1e9ba-b218-4cfc-9a7f-a5fc4eb851f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:11 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-aa630539-ef97-4f60-ad1d-8871383be8c9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Created volume successfully. Apr 21 20:58:12 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-883ce127-b9ac-4111-90b2-30f479b2334d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "cinder-0efb39d1-0072-4f93-bd29-d40e8847820f-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:12 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-883ce127-b9ac-4111-90b2-30f479b2334d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-0efb39d1-0072-4f93-bd29-d40e8847820f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:12 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-883ce127-b9ac-4111-90b2-30f479b2334d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "cinder-quobyte-0efb39d1-0072-4f93-bd29-d40e8847820f" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:12 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-883ce127-b9ac-4111-90b2-30f479b2334d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-quobyte-0efb39d1-0072-4f93-bd29-d40e8847820f" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:12 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[837c7a5a-8ea6-45b5-a676-2707ae969544]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-883ce127-b9ac-4111-90b2-30f479b2334d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0efb39d1-0072-4f93-bd29-d40e8847820f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:12 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0efb39d1-0072-4f93-bd29-d40e8847820f Apr 21 20:58:12 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:12 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-883ce127-b9ac-4111-90b2-30f479b2334d tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0efb39d1-0072-4f93-bd29-d40e8847820f" returned: 0 in 0.527s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-883ce127-b9ac-4111-90b2-30f479b2334d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0efb39d1-0072-4f93-bd29-d40e8847820f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:12 devstack sudo[89163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0efb39d1-0072-4f93-bd29-d40e8847820f Apr 21 20:58:12 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:13 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-883ce127-b9ac-4111-90b2-30f479b2334d tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0efb39d1-0072-4f93-bd29-d40e8847820f" returned: 0 in 0.415s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-883ce127-b9ac-4111-90b2-30f479b2334d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-quobyte-0efb39d1-0072-4f93-bd29-d40e8847820f" released by "delete_volume" :: held 0.972s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:13 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-883ce127-b9ac-4111-90b2-30f479b2334d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Created reservations ['46679b0a-311f-4b93-a9d4-b3155e33f8a0', '5f3cc53f-4bf9-4396-9ec6-70d25d49c7b9', 'ddcc1899-2280-4e15-8fa9-89b8d51f98e8', 'eb990323-d9ff-41cc-826c-627c0b76dbc2'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-883ce127-b9ac-4111-90b2-30f479b2334d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-883ce127-b9ac-4111-90b2-30f479b2334d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:13 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-883ce127-b9ac-4111-90b2-30f479b2334d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:13 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-883ce127-b9ac-4111-90b2-30f479b2334d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-883ce127-b9ac-4111-90b2-30f479b2334d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-883ce127-b9ac-4111-90b2-30f479b2334d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8fbad7a4-132d-4366-9618-2cccde32b400 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "cinder-9e1b26b9-ffed-4077-a346-d19c24681187-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:13 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:58:13 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8fbad7a4-132d-4366-9618-2cccde32b400 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-9e1b26b9-ffed-4077-a346-d19c24681187-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8fbad7a4-132d-4366-9618-2cccde32b400 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "cinder-quobyte-9e1b26b9-ffed-4077-a346-d19c24681187" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8fbad7a4-132d-4366-9618-2cccde32b400 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-quobyte-9e1b26b9-ffed-4077-a346-d19c24681187" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:13 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[acec87ec-5f2a-44d2-9dc3-91f5c3b7030e]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8fbad7a4-132d-4366-9618-2cccde32b400 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9e1b26b9-ffed-4077-a346-d19c24681187 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:13 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9e1b26b9-ffed-4077-a346-d19c24681187 Apr 21 20:58:13 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:14 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-883ce127-b9ac-4111-90b2-30f479b2334d tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.511s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:14 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-883ce127-b9ac-4111-90b2-30f479b2334d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:14 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-883ce127-b9ac-4111-90b2-30f479b2334d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Deleted volume successfully. Apr 21 20:58:14 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-883ce127-b9ac-4111-90b2-30f479b2334d tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-0efb39d1-0072-4f93-bd29-d40e8847820f-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:14 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8fbad7a4-132d-4366-9618-2cccde32b400 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9e1b26b9-ffed-4077-a346-d19c24681187" returned: 0 in 0.542s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8fbad7a4-132d-4366-9618-2cccde32b400 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9e1b26b9-ffed-4077-a346-d19c24681187 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:14 devstack sudo[89174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9e1b26b9-ffed-4077-a346-d19c24681187 Apr 21 20:58:14 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:14 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8fbad7a4-132d-4366-9618-2cccde32b400 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9e1b26b9-ffed-4077-a346-d19c24681187" returned: 0 in 0.470s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:14 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8fbad7a4-132d-4366-9618-2cccde32b400 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-quobyte-9e1b26b9-ffed-4077-a346-d19c24681187" released by "delete_volume" :: held 1.037s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:14 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-8fbad7a4-132d-4366-9618-2cccde32b400 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Created reservations ['7c07c822-5bf2-4319-8162-2ab49337541f', '364a2f35-7c7a-41b6-b5a5-412508b35a9a', 'd2692d3d-828d-407b-b7c6-822a47cf0ed9', '86c77a3a-000b-423e-84c0-0bfcdc07ab39'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8fbad7a4-132d-4366-9618-2cccde32b400 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8fbad7a4-132d-4366-9618-2cccde32b400 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:14 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8fbad7a4-132d-4366-9618-2cccde32b400 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:14 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8fbad7a4-132d-4366-9618-2cccde32b400 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8fbad7a4-132d-4366-9618-2cccde32b400 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8fbad7a4-132d-4366-9618-2cccde32b400 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:14 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:58:14 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:15 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8fbad7a4-132d-4366-9618-2cccde32b400 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.426s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:15 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-8fbad7a4-132d-4366-9618-2cccde32b400 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:15 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-8fbad7a4-132d-4366-9618-2cccde32b400 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Deleted volume successfully. Apr 21 20:58:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8fbad7a4-132d-4366-9618-2cccde32b400 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-9e1b26b9-ffed-4077-a346-d19c24681187-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-930fcda1-b81b-4d48-a862-4c89118bb3cf tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "cinder-743b54b4-404e-4884-823c-87d1c8873164-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-930fcda1-b81b-4d48-a862-4c89118bb3cf tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-743b54b4-404e-4884-823c-87d1c8873164-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-930fcda1-b81b-4d48-a862-4c89118bb3cf tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "cinder-quobyte-743b54b4-404e-4884-823c-87d1c8873164" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-930fcda1-b81b-4d48-a862-4c89118bb3cf tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-quobyte-743b54b4-404e-4884-823c-87d1c8873164" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:15 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a56161-6367-4ab6-ac46-7f3e705c98c2]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-930fcda1-b81b-4d48-a862-4c89118bb3cf tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-743b54b4-404e-4884-823c-87d1c8873164 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:16 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-743b54b4-404e-4884-823c-87d1c8873164 Apr 21 20:58:16 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:16 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-930fcda1-b81b-4d48-a862-4c89118bb3cf tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-743b54b4-404e-4884-823c-87d1c8873164" returned: 0 in 0.523s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-930fcda1-b81b-4d48-a862-4c89118bb3cf tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-743b54b4-404e-4884-823c-87d1c8873164 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:16 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-743b54b4-404e-4884-823c-87d1c8873164 Apr 21 20:58:16 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:16 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-930fcda1-b81b-4d48-a862-4c89118bb3cf tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-743b54b4-404e-4884-823c-87d1c8873164" returned: 0 in 0.423s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:16 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-930fcda1-b81b-4d48-a862-4c89118bb3cf tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-quobyte-743b54b4-404e-4884-823c-87d1c8873164" released by "delete_volume" :: held 0.969s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:16 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-930fcda1-b81b-4d48-a862-4c89118bb3cf tempest-CreateVolumesFromSnapshotTest-1570523949 None] Created reservations ['7f744a90-4f0d-455e-a6c0-185899d3ee5d', '9572c4ce-700f-4377-bc0f-b4e043a9844e', 'b941d9ff-6a37-4e6f-a77a-14b5d3fa73b6', '3610aaad-f7fb-4a1e-814a-1ca1133e39eb'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-930fcda1-b81b-4d48-a862-4c89118bb3cf tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-930fcda1-b81b-4d48-a862-4c89118bb3cf tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:16 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-930fcda1-b81b-4d48-a862-4c89118bb3cf tempest-CreateVolumesFromSnapshotTest-1570523949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:16 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-930fcda1-b81b-4d48-a862-4c89118bb3cf tempest-CreateVolumesFromSnapshotTest-1570523949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-930fcda1-b81b-4d48-a862-4c89118bb3cf tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-930fcda1-b81b-4d48-a862-4c89118bb3cf tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:16 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:58:16 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:17 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7a97e2fd-20f3-4787-9f79-6626a60819e9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "cinder-248334eb-7713-4d10-a914-52abea43406e-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:17 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7a97e2fd-20f3-4787-9f79-6626a60819e9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-248334eb-7713-4d10-a914-52abea43406e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:17 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7a97e2fd-20f3-4787-9f79-6626a60819e9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "cinder-quobyte-248334eb-7713-4d10-a914-52abea43406e" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:17 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7a97e2fd-20f3-4787-9f79-6626a60819e9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-quobyte-248334eb-7713-4d10-a914-52abea43406e" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:17 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[5294f337-ba05-4394-80dc-cfe9c3b8fe88]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7a97e2fd-20f3-4787-9f79-6626a60819e9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-248334eb-7713-4d10-a914-52abea43406e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:17 devstack sudo[89190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-248334eb-7713-4d10-a914-52abea43406e Apr 21 20:58:17 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:17 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-930fcda1-b81b-4d48-a862-4c89118bb3cf tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.416s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:17 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-930fcda1-b81b-4d48-a862-4c89118bb3cf tempest-CreateVolumesFromSnapshotTest-1570523949 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:17 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-930fcda1-b81b-4d48-a862-4c89118bb3cf tempest-CreateVolumesFromSnapshotTest-1570523949 None] Deleted volume successfully. Apr 21 20:58:17 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-930fcda1-b81b-4d48-a862-4c89118bb3cf tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-743b54b4-404e-4884-823c-87d1c8873164-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:17 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7a97e2fd-20f3-4787-9f79-6626a60819e9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-248334eb-7713-4d10-a914-52abea43406e" returned: 0 in 0.543s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7a97e2fd-20f3-4787-9f79-6626a60819e9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-248334eb-7713-4d10-a914-52abea43406e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:17 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-248334eb-7713-4d10-a914-52abea43406e Apr 21 20:58:17 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:18 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7a97e2fd-20f3-4787-9f79-6626a60819e9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-248334eb-7713-4d10-a914-52abea43406e" returned: 0 in 0.407s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:18 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7a97e2fd-20f3-4787-9f79-6626a60819e9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-quobyte-248334eb-7713-4d10-a914-52abea43406e" released by "delete_volume" :: held 0.977s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:18 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-7a97e2fd-20f3-4787-9f79-6626a60819e9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Created reservations ['bc384e54-5af5-4790-ad9f-ae882431b937', '0c4b2540-0400-4e13-8ace-44f3a6dea8ba', '83fcfc97-83e6-4766-8dcd-5d3b89386253', 'e459c420-562b-493f-b2c3-468cd930f0cf'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7a97e2fd-20f3-4787-9f79-6626a60819e9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7a97e2fd-20f3-4787-9f79-6626a60819e9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7a97e2fd-20f3-4787-9f79-6626a60819e9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7a97e2fd-20f3-4787-9f79-6626a60819e9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7a97e2fd-20f3-4787-9f79-6626a60819e9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7a97e2fd-20f3-4787-9f79-6626a60819e9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:18 devstack sudo[89199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:58:18 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:18 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7a97e2fd-20f3-4787-9f79-6626a60819e9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.404s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:18 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-7a97e2fd-20f3-4787-9f79-6626a60819e9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:18 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-7a97e2fd-20f3-4787-9f79-6626a60819e9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Deleted volume successfully. Apr 21 20:58:18 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7a97e2fd-20f3-4787-9f79-6626a60819e9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-248334eb-7713-4d10-a914-52abea43406e-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:19 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-12db5be2-e0ac-499d-9405-d0ae18b25260 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "cinder-63fdf5a9-469c-44cd-817f-0b8f35860cc4-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:19 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-12db5be2-e0ac-499d-9405-d0ae18b25260 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-63fdf5a9-469c-44cd-817f-0b8f35860cc4-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:19 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-12db5be2-e0ac-499d-9405-d0ae18b25260 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "cinder-quobyte-63fdf5a9-469c-44cd-817f-0b8f35860cc4" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:19 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-12db5be2-e0ac-499d-9405-d0ae18b25260 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-quobyte-63fdf5a9-469c-44cd-817f-0b8f35860cc4" acquired by "delete_volume" :: waited 0.006s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:19 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[092b3494-7457-46b3-985a-41ff268b0aea]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-12db5be2-e0ac-499d-9405-d0ae18b25260 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-63fdf5a9-469c-44cd-817f-0b8f35860cc4 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:19 devstack sudo[89203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-63fdf5a9-469c-44cd-817f-0b8f35860cc4 Apr 21 20:58:19 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:19 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-12db5be2-e0ac-499d-9405-d0ae18b25260 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-63fdf5a9-469c-44cd-817f-0b8f35860cc4" returned: 0 in 0.527s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-12db5be2-e0ac-499d-9405-d0ae18b25260 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-63fdf5a9-469c-44cd-817f-0b8f35860cc4 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:19 devstack sudo[89208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-63fdf5a9-469c-44cd-817f-0b8f35860cc4 Apr 21 20:58:19 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:20 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-12db5be2-e0ac-499d-9405-d0ae18b25260 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-63fdf5a9-469c-44cd-817f-0b8f35860cc4" returned: 0 in 0.478s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:20 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-12db5be2-e0ac-499d-9405-d0ae18b25260 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-quobyte-63fdf5a9-469c-44cd-817f-0b8f35860cc4" released by "delete_volume" :: held 1.032s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:20 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-12db5be2-e0ac-499d-9405-d0ae18b25260 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Created reservations ['1f4909b4-738b-4810-94eb-3a56cc9d53f3', '5335e785-eb3f-47f0-940f-668b394d53d7', 'a2397f6f-7058-4e41-a43a-9ed449133989', '63b08014-f3a4-4bec-99c0-9d7882b4e7b0'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-12db5be2-e0ac-499d-9405-d0ae18b25260 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-12db5be2-e0ac-499d-9405-d0ae18b25260 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-12db5be2-e0ac-499d-9405-d0ae18b25260 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-12db5be2-e0ac-499d-9405-d0ae18b25260 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-12db5be2-e0ac-499d-9405-d0ae18b25260 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-12db5be2-e0ac-499d-9405-d0ae18b25260 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:20 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:58:20 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:20 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-12db5be2-e0ac-499d-9405-d0ae18b25260 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.425s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:20 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-12db5be2-e0ac-499d-9405-d0ae18b25260 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:20 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-12db5be2-e0ac-499d-9405-d0ae18b25260 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Deleted volume successfully. Apr 21 20:58:20 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-12db5be2-e0ac-499d-9405-d0ae18b25260 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-63fdf5a9-469c-44cd-817f-0b8f35860cc4-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:21 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-93d4e309-4ab1-476d-ac52-b5e6d9283c42 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "cinder-566f4ad6-5e99-4153-83b9-1f77c035f615-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:21 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-93d4e309-4ab1-476d-ac52-b5e6d9283c42 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-566f4ad6-5e99-4153-83b9-1f77c035f615-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:21 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-93d4e309-4ab1-476d-ac52-b5e6d9283c42 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "cinder-quobyte-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:21 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-93d4e309-4ab1-476d-ac52-b5e6d9283c42 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-quobyte-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:21 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-93d4e309-4ab1-476d-ac52-b5e6d9283c42 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "cinder-quobyte-566f4ad6-5e99-4153-83b9-1f77c035f615" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:21 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-93d4e309-4ab1-476d-ac52-b5e6d9283c42 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-quobyte-566f4ad6-5e99-4153-83b9-1f77c035f615" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:21 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-93d4e309-4ab1-476d-ac52-b5e6d9283c42 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Deleting offline snapshot 566f4ad6-5e99-4153-83b9-1f77c035f615 of volume 93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:58:21 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-93d4e309-4ab1-476d-ac52-b5e6d9283c42 tempest-CreateVolumesFromSnapshotTest-1570523949 None] snapshot_file for this snap is: volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.566f4ad6-5e99-4153-83b9-1f77c035f615 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:58:21 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc48a88-77f0-492e-8077-b59bf759988b]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-93d4e309-4ab1-476d-ac52-b5e6d9283c42 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.566f4ad6-5e99-4153-83b9-1f77c035f615 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:21 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.566f4ad6-5e99-4153-83b9-1f77c035f615 Apr 21 20:58:21 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:21 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-93d4e309-4ab1-476d-ac52-b5e6d9283c42 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.566f4ad6-5e99-4153-83b9-1f77c035f615" returned: 0 in 0.494s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:21 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-93d4e309-4ab1-476d-ac52-b5e6d9283c42 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:58:21 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32370a5-757b-4d2f-b464-934453a79c58]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-93d4e309-4ab1-476d-ac52-b5e6d9283c42 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:22 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0 Apr 21 20:58:22 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:22 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-93d4e309-4ab1-476d-ac52-b5e6d9283c42 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0" returned: 0 in 0.549s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-93d4e309-4ab1-476d-ac52-b5e6d9283c42 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.566f4ad6-5e99-4153-83b9-1f77c035f615 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:22 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.566f4ad6-5e99-4153-83b9-1f77c035f615 Apr 21 20:58:22 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:22 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-93d4e309-4ab1-476d-ac52-b5e6d9283c42 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.566f4ad6-5e99-4153-83b9-1f77c035f615" returned: 0 in 0.494s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-93d4e309-4ab1-476d-ac52-b5e6d9283c42 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.566f4ad6-5e99-4153-83b9-1f77c035f615 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:23 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.566f4ad6-5e99-4153-83b9-1f77c035f615 Apr 21 20:58:23 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:23 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-93d4e309-4ab1-476d-ac52-b5e6d9283c42 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0.566f4ad6-5e99-4153-83b9-1f77c035f615" returned: 0 in 0.482s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:23 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-93d4e309-4ab1-476d-ac52-b5e6d9283c42 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-quobyte-566f4ad6-5e99-4153-83b9-1f77c035f615" released by "_delete_snapshot" :: held 2.079s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:23 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-93d4e309-4ab1-476d-ac52-b5e6d9283c42 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-quobyte-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0" released by "delete_snapshot" :: held 2.091s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:23 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-93d4e309-4ab1-476d-ac52-b5e6d9283c42 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Created reservations ['887d8ade-0cdc-41e1-b184-f4566e198c06', '4db58504-38c6-40f0-b7c4-b3f592570f26', '3fe8d2ca-8b09-4b63-8cbb-cd7f04d5767f', '5c013d1d-5ef4-4cb9-9288-d72eb19a5d75'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:23 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-93d4e309-4ab1-476d-ac52-b5e6d9283c42 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Delete snapshot completed successfully. Apr 21 20:58:23 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-93d4e309-4ab1-476d-ac52-b5e6d9283c42 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-566f4ad6-5e99-4153-83b9-1f77c035f615-delete_snapshot" released by "delete_snapshot" :: held 2.182s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1ad5646c-8772-4dc4-9174-c887547b5cb9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "cinder-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1ad5646c-8772-4dc4-9174-c887547b5cb9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1ad5646c-8772-4dc4-9174-c887547b5cb9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "cinder-quobyte-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1ad5646c-8772-4dc4-9174-c887547b5cb9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-quobyte-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[3082ea3e-9f3f-47ee-bca2-b6981bd921df]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1ad5646c-8772-4dc4-9174-c887547b5cb9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:24 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0 Apr 21 20:58:24 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Flow 'volume_create_manager' (775678db-da01-4ff6-8243-04c3038f359e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a4f819-0c03-468b-bd99-1984ddc2d6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a4f819-0c03-468b-bd99-1984ddc2d6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-893923829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d025e53c-d093-48b0-9c58-d66c0b6e70f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a398b10b445e4802a0db7de55905a396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:25Z,use_quota=True,user_id='610dde79724a4e0dbe0e3eaafaa26c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b35c53f3-78c8-482a-91df-424cc92b5cac),volume_type_id=b35c53f3-78c8-482a-91df-424cc92b5cac)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6cd977f-8494-4eba-97f2-b267c521f8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6cd977f-8494-4eba-97f2-b267c521f8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce7b30d-74c8-41a8-9eb6-8044d17354c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce7b30d-74c8-41a8-9eb6-8044d17354c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd025e53c-d093-48b0-9c58-d66c0b6e70f1', 'volume_name': 'volume-d025e53c-d093-48b0-9c58-d66c0b6e70f1', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33b1f66-bdd1-4bc0-affc-7fe3974957fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33b1f66-bdd1-4bc0-affc-7fe3974957fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9751b37-5ca6-4877-864e-22330d30e400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:24 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Volume d025e53c-d093-48b0-9c58-d66c0b6e70f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d025e53c-d093-48b0-9c58-d66c0b6e70f1', 'volume_size': 1} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-893923829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d025e53c-d093-48b0-9c58-d66c0b6e70f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a398b10b445e4802a0db7de55905a396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:25Z,use_quota=True,user_id='610dde79724a4e0dbe0e3eaafaa26c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b35c53f3-78c8-482a-91df-424cc92b5cac),volume_type_id=b35c53f3-78c8-482a-91df-424cc92b5cac)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Creating volume d025e53c-d093-48b0-9c58-d66c0b6e70f1 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:24 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:58:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d025e53c-d093-48b0-9c58-d66c0b6e70f1 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:24 devstack sudo[89236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d025e53c-d093-48b0-9c58-d66c0b6e70f1 1073741824 Apr 21 20:58:24 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:25 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1ad5646c-8772-4dc4-9174-c887547b5cb9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0" returned: 0 in 0.492s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1ad5646c-8772-4dc4-9174-c887547b5cb9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:25 devstack sudo[89241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0 Apr 21 20:58:25 devstack sudo[89241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:25 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d025e53c-d093-48b0-9c58-d66c0b6e70f1 1073741824" returned: 0 in 0.513s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d025e53c-d093-48b0-9c58-d66c0b6e70f1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:25 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d025e53c-d093-48b0-9c58-d66c0b6e70f1 Apr 21 20:58:25 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:25 devstack sudo[89241]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1ad5646c-8772-4dc4-9174-c887547b5cb9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0" returned: 0 in 0.408s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1ad5646c-8772-4dc4-9174-c887547b5cb9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-quobyte-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0" released by "delete_volume" :: held 0.937s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:25 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-1ad5646c-8772-4dc4-9174-c887547b5cb9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Created reservations ['ca6d631a-5295-41d7-bab7-1c6af7eb1e2c', '1e9e3734-d037-4b67-b99a-17b58327141e', '9cd3b71e-e510-4d17-be05-a8f3cd1d9bc5', 'e807d47c-3b0b-4193-94da-ce196368cc19'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1ad5646c-8772-4dc4-9174-c887547b5cb9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1ad5646c-8772-4dc4-9174-c887547b5cb9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:25 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-1ad5646c-8772-4dc4-9174-c887547b5cb9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:25 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-1ad5646c-8772-4dc4-9174-c887547b5cb9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-1ad5646c-8772-4dc4-9174-c887547b5cb9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1ad5646c-8772-4dc4-9174-c887547b5cb9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:25 devstack sudo[89249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:58:25 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:25 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d025e53c-d093-48b0-9c58-d66c0b6e70f1" returned: 0 in 0.459s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:25 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:25 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9751b37-5ca6-4877-864e-22330d30e400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d025e53c-d093-48b0-9c58-d66c0b6e70f1', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:25 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ee1c52-6263-402c-bba8-c97985980a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:25 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Volume volume-d025e53c-d093-48b0-9c58-d66c0b6e70f1 (d025e53c-d093-48b0-9c58-d66c0b6e70f1): created successfully Apr 21 20:58:25 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ee1c52-6263-402c-bba8-c97985980a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:25 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Flow 'volume_create_manager' (775678db-da01-4ff6-8243-04c3038f359e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:25 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-4b9562ca-10df-4d33-ab78-7030c7ece9e1 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Created volume successfully. Apr 21 20:58:26 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1ad5646c-8772-4dc4-9174-c887547b5cb9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.422s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:26 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-1ad5646c-8772-4dc4-9174-c887547b5cb9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:26 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-1ad5646c-8772-4dc4-9174-c887547b5cb9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Deleted volume successfully. Apr 21 20:58:26 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1ad5646c-8772-4dc4-9174-c887547b5cb9 tempest-CreateVolumesFromSnapshotTest-1570523949 None] Lock "cinder-93c7db7f-f2d1-4e7b-a82a-bcf4571b22c0-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a49bb6f9-55ce-4da9-82b2-7c2b90573dd0 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a49bb6f9-55ce-4da9-82b2-7c2b90573dd0 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:27 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a49bb6f9-55ce-4da9-82b2-7c2b90573dd0 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:27 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a49bb6f9-55ce-4da9-82b2-7c2b90573dd0 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a49bb6f9-55ce-4da9-82b2-7c2b90573dd0 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a49bb6f9-55ce-4da9-82b2-7c2b90573dd0 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:27 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:58:27 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:27 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a49bb6f9-55ce-4da9-82b2-7c2b90573dd0 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.386s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:27 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-a49bb6f9-55ce-4da9-82b2-7c2b90573dd0 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:27 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-a49bb6f9-55ce-4da9-82b2-7c2b90573dd0 tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Retype volume completed successfully. Apr 21 20:58:28 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b5b83737-949e-41fa-93bd-9e4de05e58bc tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Acquiring lock "cinder-d025e53c-d093-48b0-9c58-d66c0b6e70f1-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:28 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b5b83737-949e-41fa-93bd-9e4de05e58bc tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Lock "cinder-d025e53c-d093-48b0-9c58-d66c0b6e70f1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:28 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b5b83737-949e-41fa-93bd-9e4de05e58bc tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Acquiring lock "cinder-quobyte-d025e53c-d093-48b0-9c58-d66c0b6e70f1" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:28 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b5b83737-949e-41fa-93bd-9e4de05e58bc tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Lock "cinder-quobyte-d025e53c-d093-48b0-9c58-d66c0b6e70f1" acquired by "delete_volume" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:28 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace30088-e732-43f5-8d03-fb5689dd2e73]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b5b83737-949e-41fa-93bd-9e4de05e58bc tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d025e53c-d093-48b0-9c58-d66c0b6e70f1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:28 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d025e53c-d093-48b0-9c58-d66c0b6e70f1 Apr 21 20:58:28 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:28 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b5b83737-949e-41fa-93bd-9e4de05e58bc tempest-VolumeRetypeWithoutMigrationTest-626676282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d025e53c-d093-48b0-9c58-d66c0b6e70f1" returned: 0 in 0.445s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b5b83737-949e-41fa-93bd-9e4de05e58bc tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d025e53c-d093-48b0-9c58-d66c0b6e70f1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:28 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d025e53c-d093-48b0-9c58-d66c0b6e70f1 Apr 21 20:58:28 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:29 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b5b83737-949e-41fa-93bd-9e4de05e58bc tempest-VolumeRetypeWithoutMigrationTest-626676282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d025e53c-d093-48b0-9c58-d66c0b6e70f1" returned: 0 in 0.382s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:29 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b5b83737-949e-41fa-93bd-9e4de05e58bc tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Lock "cinder-quobyte-d025e53c-d093-48b0-9c58-d66c0b6e70f1" released by "delete_volume" :: held 0.858s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:29 devstack cinder-volume[81957]: WARNING cinder.quota [None req-b5b83737-949e-41fa-93bd-9e4de05e58bc tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:58:29 devstack cinder-volume[81957]: WARNING cinder.quota [None req-b5b83737-949e-41fa-93bd-9e4de05e58bc tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:58:29 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-b5b83737-949e-41fa-93bd-9e4de05e58bc tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Created reservations ['7dc08ea8-66c9-4e60-9686-8b0f8e99d33f', 'eab267f4-5c66-422f-84b2-db0e5dfbe046', '89dec160-9336-4563-9e04-d5b4297f50bf', '73467565-1378-44d2-9a59-f0537ae28f71'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b5b83737-949e-41fa-93bd-9e4de05e58bc tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b5b83737-949e-41fa-93bd-9e4de05e58bc tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b5b83737-949e-41fa-93bd-9e4de05e58bc tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b5b83737-949e-41fa-93bd-9e4de05e58bc tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b5b83737-949e-41fa-93bd-9e4de05e58bc tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b5b83737-949e-41fa-93bd-9e4de05e58bc tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:29 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:58:29 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:29 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b5b83737-949e-41fa-93bd-9e4de05e58bc tempest-VolumeRetypeWithoutMigrationTest-626676282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.426s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:29 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-b5b83737-949e-41fa-93bd-9e4de05e58bc tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:29 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-b5b83737-949e-41fa-93bd-9e4de05e58bc tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Deleted volume successfully. Apr 21 20:58:29 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b5b83737-949e-41fa-93bd-9e4de05e58bc tempest-VolumeRetypeWithoutMigrationTest-626676282 None] Lock "cinder-d025e53c-d093-48b0-9c58-d66c0b6e70f1-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:39 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:SELECT=167,cinder:UPDATE=218,cinder:INSERT=49,cinder:DELETE=11 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:58:39 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:SELECT=154,cinder:UPDATE=198,cinder:INSERT=49,cinder:DELETE=16 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:58:53 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:SELECT=1 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:58:53 devstack cinder-volume[81957]: DEBUG oslo_service.periodic_task [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81957) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:58:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:53 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:UPDATE=1 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:58:53 devstack sudo[89297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:58:53 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:54 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.398s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:54 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:58 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Flow 'volume_create_manager' (9469748f-2c3c-4cca-8eb0-a2ad87f1be42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23201345-3478-4dc2-abea-793fee4a674b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23201345-3478-4dc2-abea-793fee4a674b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-309930921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ae1f0e-ae0f-4b26-9ecc-c071551ecca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0f05debbf149a19707c427720b6d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:59Z,use_quota=True,user_id='16e3bfce1a6346459727dde7fe4bb0c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c01c337-f7b7-493d-b834-c9382674776e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c01c337-f7b7-493d-b834-c9382674776e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa4e6e48-fa30-4f8d-9875-6cdf75cea4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa4e6e48-fa30-4f8d-9875-6cdf75cea4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89ae1f0e-ae0f-4b26-9ecc-c071551ecca1', 'volume_name': 'volume-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (493542a3-a85d-4fac-9513-5dd1fd4af9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (493542a3-a85d-4fac-9513-5dd1fd4af9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c7f30c-4fd4-4592-99b3-1b80b29b4466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:58 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Volume 89ae1f0e-ae0f-4b26-9ecc-c071551ecca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1', 'volume_size': 1} Apr 21 20:58:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-309930921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ae1f0e-ae0f-4b26-9ecc-c071551ecca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0f05debbf149a19707c427720b6d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:59Z,use_quota=True,user_id='16e3bfce1a6346459727dde7fe4bb0c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Creating volume 89ae1f0e-ae0f-4b26-9ecc-c071551ecca1 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:58 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:58:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:58 devstack sudo[89366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1 1073741824 Apr 21 20:58:58 devstack sudo[89366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:59 devstack sudo[89366]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1 1073741824" returned: 0 in 0.481s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:59 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1 Apr 21 20:58:59 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:59 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1" returned: 0 in 0.410s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c7f30c-4fd4-4592-99b3-1b80b29b4466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aefaa859-8f92-4448-9968-1185d3ca4344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:59 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Volume volume-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1 (89ae1f0e-ae0f-4b26-9ecc-c071551ecca1): created successfully Apr 21 20:58:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aefaa859-8f92-4448-9968-1185d3ca4344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Flow 'volume_create_manager' (9469748f-2c3c-4cca-8eb0-a2ad87f1be42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:59 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-3b5fc891-a607-4b7c-8875-6b42230d5599 tempest-VolumesActionsTest-2130612724 None] Created volume successfully. Apr 21 20:59:00 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-d3da2105-efd6-4eb6-984d-21e05e411b01 tempest-VolumesActionsTest-2130612724 None] Acquiring lock "cinder-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1" by "attach_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:00 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-d3da2105-efd6-4eb6-984d-21e05e411b01 tempest-VolumesActionsTest-2130612724 None] Lock "cinder-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1" acquired by "attach_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:01 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-d3da2105-efd6-4eb6-984d-21e05e411b01 tempest-VolumesActionsTest-2130612724 None] Attaching volume 89ae1f0e-ae0f-4b26-9ecc-c071551ecca1 to instance ba4ab84e-1dc7-4b44-b3b1-37edee200964 at mountpoint /dev/vdb on host None. Apr 21 20:59:01 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-d3da2105-efd6-4eb6-984d-21e05e411b01 tempest-VolumesActionsTest-2130612724 None] Attach volume completed successfully. Apr 21 20:59:01 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-d3da2105-efd6-4eb6-984d-21e05e411b01 tempest-VolumesActionsTest-2130612724 None] Lock "cinder-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1" released by "attach_volume" :: held 0.049s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:01 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-b456ad9f-a22f-40ae-9097-1340d0d1cf3d tempest-VolumesActionsTest-361986438 None] Terminate volume connection completed successfully. Apr 21 20:59:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b456ad9f-a22f-40ae-9097-1340d0d1cf3d tempest-VolumesActionsTest-361986438 None] Acquiring lock "cinder-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1-detach_volume" by "detach_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b456ad9f-a22f-40ae-9097-1340d0d1cf3d tempest-VolumesActionsTest-361986438 None] Lock "cinder-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:02 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-b456ad9f-a22f-40ae-9097-1340d0d1cf3d tempest-VolumesActionsTest-361986438 None] Detaching volume 89ae1f0e-ae0f-4b26-9ecc-c071551ecca1 from instance ba4ab84e-1dc7-4b44-b3b1-37edee200964. Apr 21 20:59:02 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-b456ad9f-a22f-40ae-9097-1340d0d1cf3d tempest-VolumesActionsTest-361986438 None] Detach volume completed successfully. Apr 21 20:59:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b456ad9f-a22f-40ae-9097-1340d0d1cf3d tempest-VolumesActionsTest-361986438 None] Lock "cinder-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b73b2976-79f5-4c22-b86e-a6ff9da75a71 tempest-VolumesActionsTest-2130612724 None] Acquiring lock "cinder-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1-detach_volume" by "detach_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b73b2976-79f5-4c22-b86e-a6ff9da75a71 tempest-VolumesActionsTest-2130612724 None] Lock "cinder-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:02 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-b73b2976-79f5-4c22-b86e-a6ff9da75a71 tempest-VolumesActionsTest-2130612724 None] Volume detach called, but volume not attached. Apr 21 20:59:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b73b2976-79f5-4c22-b86e-a6ff9da75a71 tempest-VolumesActionsTest-2130612724 None] Lock "cinder-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1-detach_volume" released by "detach_volume" :: held 0.013s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a71dc9b7-080d-4f4f-86c3-39c53a27d8bc tempest-VolumesActionsTest-2130612724 None] Acquiring lock "cinder-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a71dc9b7-080d-4f4f-86c3-39c53a27d8bc tempest-VolumesActionsTest-2130612724 None] Lock "cinder-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a71dc9b7-080d-4f4f-86c3-39c53a27d8bc tempest-VolumesActionsTest-2130612724 None] Acquiring lock "cinder-quobyte-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a71dc9b7-080d-4f4f-86c3-39c53a27d8bc tempest-VolumesActionsTest-2130612724 None] Lock "cinder-quobyte-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1" acquired by "delete_volume" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:03 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e63a1ff-81ce-4d4e-a17e-79a9487309c0]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a71dc9b7-080d-4f4f-86c3-39c53a27d8bc tempest-VolumesActionsTest-2130612724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:03 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1 Apr 21 20:59:03 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:04 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a71dc9b7-080d-4f4f-86c3-39c53a27d8bc tempest-VolumesActionsTest-2130612724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1" returned: 0 in 0.440s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a71dc9b7-080d-4f4f-86c3-39c53a27d8bc tempest-VolumesActionsTest-2130612724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:04 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1 Apr 21 20:59:04 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:04 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a71dc9b7-080d-4f4f-86c3-39c53a27d8bc tempest-VolumesActionsTest-2130612724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1" returned: 0 in 0.410s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a71dc9b7-080d-4f4f-86c3-39c53a27d8bc tempest-VolumesActionsTest-2130612724 None] Lock "cinder-quobyte-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1" released by "delete_volume" :: held 0.886s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:04 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-a71dc9b7-080d-4f4f-86c3-39c53a27d8bc tempest-VolumesActionsTest-2130612724 None] Created reservations ['4ea071fb-e3bb-4c4a-a95a-dc4c2832e5ef', '04768e41-35ae-44f4-9455-d89d50bd0037', '777870ec-389b-4e34-9a8e-fe981b01973b', 'c5945c54-a654-4a8d-8f3f-94f8e4ee47bf'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a71dc9b7-080d-4f4f-86c3-39c53a27d8bc tempest-VolumesActionsTest-2130612724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a71dc9b7-080d-4f4f-86c3-39c53a27d8bc tempest-VolumesActionsTest-2130612724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a71dc9b7-080d-4f4f-86c3-39c53a27d8bc tempest-VolumesActionsTest-2130612724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a71dc9b7-080d-4f4f-86c3-39c53a27d8bc tempest-VolumesActionsTest-2130612724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a71dc9b7-080d-4f4f-86c3-39c53a27d8bc tempest-VolumesActionsTest-2130612724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a71dc9b7-080d-4f4f-86c3-39c53a27d8bc tempest-VolumesActionsTest-2130612724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:04 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:59:04 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:05 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a71dc9b7-080d-4f4f-86c3-39c53a27d8bc tempest-VolumesActionsTest-2130612724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.452s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:05 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-a71dc9b7-080d-4f4f-86c3-39c53a27d8bc tempest-VolumesActionsTest-2130612724 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:05 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-a71dc9b7-080d-4f4f-86c3-39c53a27d8bc tempest-VolumesActionsTest-2130612724 None] Deleted volume successfully. Apr 21 20:59:05 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a71dc9b7-080d-4f4f-86c3-39c53a27d8bc tempest-VolumesActionsTest-2130612724 None] Lock "cinder-89ae1f0e-ae0f-4b26-9ecc-c071551ecca1-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:10 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Flow 'volume_create_manager' (42ce05b2-bf8f-49dc-b893-7cecb25b8715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4883776-b8b6-4010-bfbf-c4815d40ab4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4883776-b8b6-4010-bfbf-c4815d40ab4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2103037501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0f05debbf149a19707c427720b6d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:11Z,use_quota=True,user_id='16e3bfce1a6346459727dde7fe4bb0c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a44388-4eed-4ff4-b7e7-0bfdfd529da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a44388-4eed-4ff4-b7e7-0bfdfd529da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5862461a-0302-4c0a-96de-02a0fbdb20f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5862461a-0302-4c0a-96de-02a0fbdb20f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93', 'volume_name': 'volume-8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dca1e20-0ad2-4b4c-8925-73a58e2f1d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dca1e20-0ad2-4b4c-8925-73a58e2f1d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0809ea34-12ef-4de3-bc14-2abdf82a5859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:10 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Volume 8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93', 'volume_size': 1} Apr 21 20:59:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2103037501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0f05debbf149a19707c427720b6d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:11Z,use_quota=True,user_id='16e3bfce1a6346459727dde7fe4bb0c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Creating volume 8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:10 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:59:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:10 devstack sudo[89420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93 1073741824 Apr 21 20:59:10 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:11 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93 1073741824" returned: 0 in 0.464s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:11 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93 Apr 21 20:59:11 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:11 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93" returned: 0 in 0.391s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:11 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0809ea34-12ef-4de3-bc14-2abdf82a5859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922492b5-f619-4cf6-b0aa-c39bb31f2f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:11 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Volume volume-8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93 (8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93): created successfully Apr 21 20:59:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922492b5-f619-4cf6-b0aa-c39bb31f2f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Flow 'volume_create_manager' (42ce05b2-bf8f-49dc-b893-7cecb25b8715) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:11 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-4533df2c-2b43-4afc-a193-39161a7db77d tempest-VolumesActionsTest-2130612724 None] Created volume successfully. Apr 21 20:59:11 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-189ba465-9598-4d5f-90cd-8bab79b2b1fa tempest-VolumesActionsTest-361986438 None] Acquiring lock "cinder-8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:11 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-189ba465-9598-4d5f-90cd-8bab79b2b1fa tempest-VolumesActionsTest-361986438 None] Lock "cinder-8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:11 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-189ba465-9598-4d5f-90cd-8bab79b2b1fa tempest-VolumesActionsTest-361986438 None] Acquiring lock "cinder-quobyte-8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:12 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-189ba465-9598-4d5f-90cd-8bab79b2b1fa tempest-VolumesActionsTest-361986438 None] Lock "cinder-quobyte-8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93" acquired by "delete_volume" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:12 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe908fb-da00-41d0-9d21-546f9b1946ab]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-189ba465-9598-4d5f-90cd-8bab79b2b1fa tempest-VolumesActionsTest-361986438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:12 devstack sudo[89428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93 Apr 21 20:59:12 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:12 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-189ba465-9598-4d5f-90cd-8bab79b2b1fa tempest-VolumesActionsTest-361986438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93" returned: 0 in 0.432s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-189ba465-9598-4d5f-90cd-8bab79b2b1fa tempest-VolumesActionsTest-361986438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:12 devstack sudo[89433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93 Apr 21 20:59:12 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:12 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-189ba465-9598-4d5f-90cd-8bab79b2b1fa tempest-VolumesActionsTest-361986438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93" returned: 0 in 0.379s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:12 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-189ba465-9598-4d5f-90cd-8bab79b2b1fa tempest-VolumesActionsTest-361986438 None] Lock "cinder-quobyte-8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93" released by "delete_volume" :: held 0.832s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:12 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-189ba465-9598-4d5f-90cd-8bab79b2b1fa tempest-VolumesActionsTest-361986438 None] Created reservations ['69ea40cc-df70-4bdd-9f87-98d35018a7e7', '530de63a-53a2-4d73-a159-017c71c46a49', '85d01789-5a0e-403d-bc3c-91e731b4b5e4', '3ec21e09-38af-4b48-971f-9ac11dd0fcee'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-189ba465-9598-4d5f-90cd-8bab79b2b1fa tempest-VolumesActionsTest-361986438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-189ba465-9598-4d5f-90cd-8bab79b2b1fa tempest-VolumesActionsTest-361986438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:12 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-189ba465-9598-4d5f-90cd-8bab79b2b1fa tempest-VolumesActionsTest-361986438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:12 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-189ba465-9598-4d5f-90cd-8bab79b2b1fa tempest-VolumesActionsTest-361986438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-189ba465-9598-4d5f-90cd-8bab79b2b1fa tempest-VolumesActionsTest-361986438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-189ba465-9598-4d5f-90cd-8bab79b2b1fa tempest-VolumesActionsTest-361986438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:12 devstack sudo[89436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:59:12 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:13 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-189ba465-9598-4d5f-90cd-8bab79b2b1fa tempest-VolumesActionsTest-361986438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.397s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-189ba465-9598-4d5f-90cd-8bab79b2b1fa tempest-VolumesActionsTest-361986438 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:13 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-189ba465-9598-4d5f-90cd-8bab79b2b1fa tempest-VolumesActionsTest-361986438 None] Deleted volume successfully. Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-189ba465-9598-4d5f-90cd-8bab79b2b1fa tempest-VolumesActionsTest-361986438 None] Lock "cinder-8a0fcd5f-5626-4eaf-bc83-f9990eb7bf93-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Flow 'volume_create_manager' (701bd998-a267-4864-906e-5b9ac5270d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53100d82-617d-4571-9ba3-4e753e3c7af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53100d82-617d-4571-9ba3-4e753e3c7af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-971989158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c2ab1b-77e4-4809-9343-4b6223258245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0f05debbf149a19707c427720b6d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:13Z,use_quota=True,user_id='16e3bfce1a6346459727dde7fe4bb0c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3df721-27c4-406a-8cf0-12d4c059ff5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3df721-27c4-406a-8cf0-12d4c059ff5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486f0ac3-7b49-4a7c-a2c2-337c2e0fcff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486f0ac3-7b49-4a7c-a2c2-337c2e0fcff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53c2ab1b-77e4-4809-9343-4b6223258245', 'volume_name': 'volume-53c2ab1b-77e4-4809-9343-4b6223258245', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0beac80b-1ba7-4129-b4b9-096c6e313c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0beac80b-1ba7-4129-b4b9-096c6e313c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1e01c5-c9f6-4ba2-b145-e6e53e0d7df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:13 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Volume 53c2ab1b-77e4-4809-9343-4b6223258245: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53c2ab1b-77e4-4809-9343-4b6223258245', 'volume_size': 1} Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-971989158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c2ab1b-77e4-4809-9343-4b6223258245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0f05debbf149a19707c427720b6d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:13Z,use_quota=True,user_id='16e3bfce1a6346459727dde7fe4bb0c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Creating volume 53c2ab1b-77e4-4809-9343-4b6223258245 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:13 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-53c2ab1b-77e4-4809-9343-4b6223258245 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:13 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-53c2ab1b-77e4-4809-9343-4b6223258245 1073741824 Apr 21 20:59:13 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:13 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-53c2ab1b-77e4-4809-9343-4b6223258245 1073741824" returned: 0 in 0.458s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-53c2ab1b-77e4-4809-9343-4b6223258245 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:13 devstack sudo[89444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-53c2ab1b-77e4-4809-9343-4b6223258245 Apr 21 20:59:13 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:14 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-53c2ab1b-77e4-4809-9343-4b6223258245" returned: 0 in 0.373s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:14 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1e01c5-c9f6-4ba2-b145-e6e53e0d7df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53c2ab1b-77e4-4809-9343-4b6223258245', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd8978e-e8c3-4d07-ab07-68b98f4fdefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:14 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Volume volume-53c2ab1b-77e4-4809-9343-4b6223258245 (53c2ab1b-77e4-4809-9343-4b6223258245): created successfully Apr 21 20:59:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd8978e-e8c3-4d07-ab07-68b98f4fdefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:14 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Flow 'volume_create_manager' (701bd998-a267-4864-906e-5b9ac5270d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:14 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-0c86e46e-f364-4fe4-9e13-45b2b1cfb065 tempest-VolumesActionsTest-2130612724 None] Created volume successfully. Apr 21 20:59:14 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f054d68e-9a38-4bb4-9c05-cdf002ecbf26 tempest-VolumesActionsTest-361986438 None] Acquiring lock "cinder-53c2ab1b-77e4-4809-9343-4b6223258245-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:14 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f054d68e-9a38-4bb4-9c05-cdf002ecbf26 tempest-VolumesActionsTest-361986438 None] Lock "cinder-53c2ab1b-77e4-4809-9343-4b6223258245-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:14 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f054d68e-9a38-4bb4-9c05-cdf002ecbf26 tempest-VolumesActionsTest-361986438 None] Acquiring lock "cinder-quobyte-53c2ab1b-77e4-4809-9343-4b6223258245" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:14 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f054d68e-9a38-4bb4-9c05-cdf002ecbf26 tempest-VolumesActionsTest-361986438 None] Lock "cinder-quobyte-53c2ab1b-77e4-4809-9343-4b6223258245" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:14 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[36967169-8a19-451e-a487-439c59ec426c]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f054d68e-9a38-4bb4-9c05-cdf002ecbf26 tempest-VolumesActionsTest-361986438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-53c2ab1b-77e4-4809-9343-4b6223258245 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:14 devstack sudo[89447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-53c2ab1b-77e4-4809-9343-4b6223258245 Apr 21 20:59:14 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:15 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f054d68e-9a38-4bb4-9c05-cdf002ecbf26 tempest-VolumesActionsTest-361986438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-53c2ab1b-77e4-4809-9343-4b6223258245" returned: 0 in 0.449s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f054d68e-9a38-4bb4-9c05-cdf002ecbf26 tempest-VolumesActionsTest-361986438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-53c2ab1b-77e4-4809-9343-4b6223258245 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:15 devstack sudo[89452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-53c2ab1b-77e4-4809-9343-4b6223258245 Apr 21 20:59:15 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:15 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f054d68e-9a38-4bb4-9c05-cdf002ecbf26 tempest-VolumesActionsTest-361986438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-53c2ab1b-77e4-4809-9343-4b6223258245" returned: 0 in 0.389s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f054d68e-9a38-4bb4-9c05-cdf002ecbf26 tempest-VolumesActionsTest-361986438 None] Lock "cinder-quobyte-53c2ab1b-77e4-4809-9343-4b6223258245" released by "delete_volume" :: held 0.858s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-f054d68e-9a38-4bb4-9c05-cdf002ecbf26 tempest-VolumesActionsTest-361986438 None] Created reservations ['91a2dfeb-3be2-488d-81d3-9f2cba650fdc', '1d3546be-3dc6-4a39-b7ba-459099f9b79c', '439bcd4e-2302-45df-ae75-55b339ad52f5', '13a1a117-f780-49a5-b7d7-badb3fa1e0b1'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f054d68e-9a38-4bb4-9c05-cdf002ecbf26 tempest-VolumesActionsTest-361986438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f054d68e-9a38-4bb4-9c05-cdf002ecbf26 tempest-VolumesActionsTest-361986438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f054d68e-9a38-4bb4-9c05-cdf002ecbf26 tempest-VolumesActionsTest-361986438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f054d68e-9a38-4bb4-9c05-cdf002ecbf26 tempest-VolumesActionsTest-361986438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f054d68e-9a38-4bb4-9c05-cdf002ecbf26 tempest-VolumesActionsTest-361986438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f054d68e-9a38-4bb4-9c05-cdf002ecbf26 tempest-VolumesActionsTest-361986438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:15 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:59:15 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:15 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Flow 'volume_create_manager' (0699a6cb-46de-4681-901a-d9db4058b37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b40305a-a0de-4288-b0e2-cf8aa9288e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f054d68e-9a38-4bb4-9c05-cdf002ecbf26 tempest-VolumesActionsTest-361986438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.442s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-f054d68e-9a38-4bb4-9c05-cdf002ecbf26 tempest-VolumesActionsTest-361986438 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b40305a-a0de-4288-b0e2-cf8aa9288e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1353375652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea372d4-4cb1-43c9-97f1-5f289f59ef43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0f05debbf149a19707c427720b6d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:16Z,use_quota=True,user_id='16e3bfce1a6346459727dde7fe4bb0c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6436813e-a87a-45cf-8e92-775db0de64fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6436813e-a87a-45cf-8e92-775db0de64fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0878715-7f6e-4b47-83a8-f9013fbedd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0878715-7f6e-4b47-83a8-f9013fbedd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bea372d4-4cb1-43c9-97f1-5f289f59ef43', 'volume_name': 'volume-bea372d4-4cb1-43c9-97f1-5f289f59ef43', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f310572-0b76-4670-979a-3a73fccca811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f310572-0b76-4670-979a-3a73fccca811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (501ecffa-2972-4622-b773-dae51dba099f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:15 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Volume bea372d4-4cb1-43c9-97f1-5f289f59ef43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bea372d4-4cb1-43c9-97f1-5f289f59ef43', 'volume_size': 1} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1353375652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea372d4-4cb1-43c9-97f1-5f289f59ef43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0f05debbf149a19707c427720b6d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:16Z,use_quota=True,user_id='16e3bfce1a6346459727dde7fe4bb0c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Creating volume bea372d4-4cb1-43c9-97f1-5f289f59ef43 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:15 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bea372d4-4cb1-43c9-97f1-5f289f59ef43 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:15 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-f054d68e-9a38-4bb4-9c05-cdf002ecbf26 tempest-VolumesActionsTest-361986438 None] Deleted volume successfully. Apr 21 20:59:15 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bea372d4-4cb1-43c9-97f1-5f289f59ef43 1073741824 Apr 21 20:59:15 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f054d68e-9a38-4bb4-9c05-cdf002ecbf26 tempest-VolumesActionsTest-361986438 None] Lock "cinder-53c2ab1b-77e4-4809-9343-4b6223258245-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:16 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bea372d4-4cb1-43c9-97f1-5f289f59ef43 1073741824" returned: 0 in 0.449s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bea372d4-4cb1-43c9-97f1-5f289f59ef43 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:16 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bea372d4-4cb1-43c9-97f1-5f289f59ef43 Apr 21 20:59:16 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:16 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bea372d4-4cb1-43c9-97f1-5f289f59ef43" returned: 0 in 0.378s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:16 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:16 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (501ecffa-2972-4622-b773-dae51dba099f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bea372d4-4cb1-43c9-97f1-5f289f59ef43', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:16 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c81ccd7-b595-4565-9f23-e2ca491bf370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:16 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Volume volume-bea372d4-4cb1-43c9-97f1-5f289f59ef43 (bea372d4-4cb1-43c9-97f1-5f289f59ef43): created successfully Apr 21 20:59:16 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c81ccd7-b595-4565-9f23-e2ca491bf370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:16 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Flow 'volume_create_manager' (0699a6cb-46de-4681-901a-d9db4058b37c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:16 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-a940b373-c410-4325-a864-1bf8b5f50839 tempest-VolumesActionsTest-2130612724 None] Created volume successfully. Apr 21 20:59:17 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-896e9fb1-b516-4a00-895e-ca799f919997 tempest-VolumesActionsTest-361986438 None] Acquiring lock "cinder-bea372d4-4cb1-43c9-97f1-5f289f59ef43-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:17 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-896e9fb1-b516-4a00-895e-ca799f919997 tempest-VolumesActionsTest-361986438 None] Lock "cinder-bea372d4-4cb1-43c9-97f1-5f289f59ef43-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:17 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-896e9fb1-b516-4a00-895e-ca799f919997 tempest-VolumesActionsTest-361986438 None] Acquiring lock "cinder-quobyte-bea372d4-4cb1-43c9-97f1-5f289f59ef43" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:17 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-896e9fb1-b516-4a00-895e-ca799f919997 tempest-VolumesActionsTest-361986438 None] Lock "cinder-quobyte-bea372d4-4cb1-43c9-97f1-5f289f59ef43" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:17 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9090d53-81e4-48f7-8cbc-1b2e34ee4698]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-896e9fb1-b516-4a00-895e-ca799f919997 tempest-VolumesActionsTest-361986438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bea372d4-4cb1-43c9-97f1-5f289f59ef43 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:17 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bea372d4-4cb1-43c9-97f1-5f289f59ef43 Apr 21 20:59:17 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:17 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-896e9fb1-b516-4a00-895e-ca799f919997 tempest-VolumesActionsTest-361986438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bea372d4-4cb1-43c9-97f1-5f289f59ef43" returned: 0 in 0.450s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-896e9fb1-b516-4a00-895e-ca799f919997 tempest-VolumesActionsTest-361986438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bea372d4-4cb1-43c9-97f1-5f289f59ef43 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:17 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bea372d4-4cb1-43c9-97f1-5f289f59ef43 Apr 21 20:59:17 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:18 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-896e9fb1-b516-4a00-895e-ca799f919997 tempest-VolumesActionsTest-361986438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bea372d4-4cb1-43c9-97f1-5f289f59ef43" returned: 0 in 0.376s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-896e9fb1-b516-4a00-895e-ca799f919997 tempest-VolumesActionsTest-361986438 None] Lock "cinder-quobyte-bea372d4-4cb1-43c9-97f1-5f289f59ef43" released by "delete_volume" :: held 0.845s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-896e9fb1-b516-4a00-895e-ca799f919997 tempest-VolumesActionsTest-361986438 None] Created reservations ['ee0acc98-60bd-47a0-927c-8ce75c806694', '8f13a004-5006-4b85-aa43-9f0c59bd8b3e', '3f9ea554-1ea8-4222-a48a-6913eb288d27', '20ffb223-2bcb-423a-b994-0d2cdc709608'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-896e9fb1-b516-4a00-895e-ca799f919997 tempest-VolumesActionsTest-361986438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-896e9fb1-b516-4a00-895e-ca799f919997 tempest-VolumesActionsTest-361986438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-896e9fb1-b516-4a00-895e-ca799f919997 tempest-VolumesActionsTest-361986438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-896e9fb1-b516-4a00-895e-ca799f919997 tempest-VolumesActionsTest-361986438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-896e9fb1-b516-4a00-895e-ca799f919997 tempest-VolumesActionsTest-361986438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-896e9fb1-b516-4a00-895e-ca799f919997 tempest-VolumesActionsTest-361986438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:18 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:59:18 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Flow 'volume_create_manager' (86e939ce-bc92-4fd7-b385-fb7ef4fdf3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bcba899-ab71-457e-82de-0e556abc52e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bcba899-ab71-457e-82de-0e556abc52e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1021236567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941367e7-3137-49cb-a5dc-1507b1b5399f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0f05debbf149a19707c427720b6d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:19Z,use_quota=True,user_id='16e3bfce1a6346459727dde7fe4bb0c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b268a95-db25-42ea-ae5e-f44c1cf9a3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:18 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b268a95-db25-42ea-ae5e-f44c1cf9a3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82250665-f3b1-4824-ab2c-ac41133beca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82250665-f3b1-4824-ab2c-ac41133beca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '941367e7-3137-49cb-a5dc-1507b1b5399f', 'volume_name': 'volume-941367e7-3137-49cb-a5dc-1507b1b5399f', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a30b803-f089-4eb6-9527-191e4cdd9409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a30b803-f089-4eb6-9527-191e4cdd9409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (accb6af8-4c72-477e-ab6c-66bb0d727cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:18 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Volume 941367e7-3137-49cb-a5dc-1507b1b5399f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-941367e7-3137-49cb-a5dc-1507b1b5399f', 'volume_size': 1} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1021236567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941367e7-3137-49cb-a5dc-1507b1b5399f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0f05debbf149a19707c427720b6d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:19Z,use_quota=True,user_id='16e3bfce1a6346459727dde7fe4bb0c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Creating volume 941367e7-3137-49cb-a5dc-1507b1b5399f {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:18 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-941367e7-3137-49cb-a5dc-1507b1b5399f 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-896e9fb1-b516-4a00-895e-ca799f919997 tempest-VolumesActionsTest-361986438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.485s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-896e9fb1-b516-4a00-895e-ca799f919997 tempest-VolumesActionsTest-361986438 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:18 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-896e9fb1-b516-4a00-895e-ca799f919997 tempest-VolumesActionsTest-361986438 None] Deleted volume successfully. Apr 21 20:59:18 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-941367e7-3137-49cb-a5dc-1507b1b5399f 1073741824 Apr 21 20:59:18 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:18 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-896e9fb1-b516-4a00-895e-ca799f919997 tempest-VolumesActionsTest-361986438 None] Lock "cinder-bea372d4-4cb1-43c9-97f1-5f289f59ef43-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:19 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-941367e7-3137-49cb-a5dc-1507b1b5399f 1073741824" returned: 0 in 0.456s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-941367e7-3137-49cb-a5dc-1507b1b5399f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:19 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-941367e7-3137-49cb-a5dc-1507b1b5399f Apr 21 20:59:19 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:19 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-941367e7-3137-49cb-a5dc-1507b1b5399f" returned: 0 in 0.382s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:19 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (accb6af8-4c72-477e-ab6c-66bb0d727cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-941367e7-3137-49cb-a5dc-1507b1b5399f', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:19 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6bf85a-c1a7-4b14-b139-f6cf8c7cbe75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:19 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Volume volume-941367e7-3137-49cb-a5dc-1507b1b5399f (941367e7-3137-49cb-a5dc-1507b1b5399f): created successfully Apr 21 20:59:19 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6bf85a-c1a7-4b14-b139-f6cf8c7cbe75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:19 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Flow 'volume_create_manager' (86e939ce-bc92-4fd7-b385-fb7ef4fdf3db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:19 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-25706f22-2c51-4424-af17-cc5513641316 tempest-VolumesActionsTest-2130612724 None] Created volume successfully. Apr 21 20:59:19 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c09d33cb-49f1-4e29-af4a-b3a2c45f41a0 tempest-VolumesActionsTest-361986438 None] Acquiring lock "cinder-941367e7-3137-49cb-a5dc-1507b1b5399f-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:19 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c09d33cb-49f1-4e29-af4a-b3a2c45f41a0 tempest-VolumesActionsTest-361986438 None] Lock "cinder-941367e7-3137-49cb-a5dc-1507b1b5399f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:19 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c09d33cb-49f1-4e29-af4a-b3a2c45f41a0 tempest-VolumesActionsTest-361986438 None] Acquiring lock "cinder-quobyte-941367e7-3137-49cb-a5dc-1507b1b5399f" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:19 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c09d33cb-49f1-4e29-af4a-b3a2c45f41a0 tempest-VolumesActionsTest-361986438 None] Lock "cinder-quobyte-941367e7-3137-49cb-a5dc-1507b1b5399f" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:19 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[943276dc-907a-4ef8-b1d9-d03fe9288530]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c09d33cb-49f1-4e29-af4a-b3a2c45f41a0 tempest-VolumesActionsTest-361986438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-941367e7-3137-49cb-a5dc-1507b1b5399f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:19 devstack sudo[89486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-941367e7-3137-49cb-a5dc-1507b1b5399f Apr 21 20:59:19 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:20 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c09d33cb-49f1-4e29-af4a-b3a2c45f41a0 tempest-VolumesActionsTest-361986438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-941367e7-3137-49cb-a5dc-1507b1b5399f" returned: 0 in 0.440s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c09d33cb-49f1-4e29-af4a-b3a2c45f41a0 tempest-VolumesActionsTest-361986438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-941367e7-3137-49cb-a5dc-1507b1b5399f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:20 devstack sudo[89491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-941367e7-3137-49cb-a5dc-1507b1b5399f Apr 21 20:59:20 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:20 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c09d33cb-49f1-4e29-af4a-b3a2c45f41a0 tempest-VolumesActionsTest-361986438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-941367e7-3137-49cb-a5dc-1507b1b5399f" returned: 0 in 0.384s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:20 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c09d33cb-49f1-4e29-af4a-b3a2c45f41a0 tempest-VolumesActionsTest-361986438 None] Lock "cinder-quobyte-941367e7-3137-49cb-a5dc-1507b1b5399f" released by "delete_volume" :: held 0.848s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:20 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-c09d33cb-49f1-4e29-af4a-b3a2c45f41a0 tempest-VolumesActionsTest-361986438 None] Created reservations ['e656f52a-07c7-4bfd-805b-2937bd8f6dcc', '886e6b16-3e80-48ae-b38f-21fbc7211b88', 'b5e3f7a6-d0c2-400e-adcd-9016f98b251a', '501d81ae-f31c-404c-8b3e-5d5c3c419536'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c09d33cb-49f1-4e29-af4a-b3a2c45f41a0 tempest-VolumesActionsTest-361986438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c09d33cb-49f1-4e29-af4a-b3a2c45f41a0 tempest-VolumesActionsTest-361986438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c09d33cb-49f1-4e29-af4a-b3a2c45f41a0 tempest-VolumesActionsTest-361986438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c09d33cb-49f1-4e29-af4a-b3a2c45f41a0 tempest-VolumesActionsTest-361986438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c09d33cb-49f1-4e29-af4a-b3a2c45f41a0 tempest-VolumesActionsTest-361986438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c09d33cb-49f1-4e29-af4a-b3a2c45f41a0 tempest-VolumesActionsTest-361986438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:20 devstack sudo[89494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:59:20 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Flow 'volume_create_manager' (cd7065b8-0168-44bf-9b12-39824b95d3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af194f69-48e2-4551-88e0-63a5f9725210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af194f69-48e2-4551-88e0-63a5f9725210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1043013133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47676a48-5daf-4f3b-a131-86341f339ecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0f05debbf149a19707c427720b6d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:21Z,use_quota=True,user_id='16e3bfce1a6346459727dde7fe4bb0c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e81792f-05b8-4c9e-ab7b-9361f86d7a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e81792f-05b8-4c9e-ab7b-9361f86d7a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1919593d-273b-45e5-a45d-10f56b36ac89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1919593d-273b-45e5-a45d-10f56b36ac89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47676a48-5daf-4f3b-a131-86341f339ecb', 'volume_name': 'volume-47676a48-5daf-4f3b-a131-86341f339ecb', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a56d960-4884-4e7d-ade0-15919351fbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a56d960-4884-4e7d-ade0-15919351fbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b8285a9-8f3a-499e-939a-ea3eb00ab079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Volume 47676a48-5daf-4f3b-a131-86341f339ecb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47676a48-5daf-4f3b-a131-86341f339ecb', 'volume_size': 1} Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1043013133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47676a48-5daf-4f3b-a131-86341f339ecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0f05debbf149a19707c427720b6d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:21Z,use_quota=True,user_id='16e3bfce1a6346459727dde7fe4bb0c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Creating volume 47676a48-5daf-4f3b-a131-86341f339ecb {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:21 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-47676a48-5daf-4f3b-a131-86341f339ecb 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c09d33cb-49f1-4e29-af4a-b3a2c45f41a0 tempest-VolumesActionsTest-361986438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.491s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-c09d33cb-49f1-4e29-af4a-b3a2c45f41a0 tempest-VolumesActionsTest-361986438 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:21 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-c09d33cb-49f1-4e29-af4a-b3a2c45f41a0 tempest-VolumesActionsTest-361986438 None] Deleted volume successfully. Apr 21 20:59:21 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-47676a48-5daf-4f3b-a131-86341f339ecb 1073741824 Apr 21 20:59:21 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c09d33cb-49f1-4e29-af4a-b3a2c45f41a0 tempest-VolumesActionsTest-361986438 None] Lock "cinder-941367e7-3137-49cb-a5dc-1507b1b5399f-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:21 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-47676a48-5daf-4f3b-a131-86341f339ecb 1073741824" returned: 0 in 0.454s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-47676a48-5daf-4f3b-a131-86341f339ecb {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:21 devstack sudo[89502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-47676a48-5daf-4f3b-a131-86341f339ecb Apr 21 20:59:21 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:22 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-47676a48-5daf-4f3b-a131-86341f339ecb" returned: 0 in 0.384s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:22 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:22 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b8285a9-8f3a-499e-939a-ea3eb00ab079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47676a48-5daf-4f3b-a131-86341f339ecb', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:22 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0764505b-c3d5-4426-9380-be2ed7ce2799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:22 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Volume volume-47676a48-5daf-4f3b-a131-86341f339ecb (47676a48-5daf-4f3b-a131-86341f339ecb): created successfully Apr 21 20:59:22 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0764505b-c3d5-4426-9380-be2ed7ce2799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:22 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Flow 'volume_create_manager' (cd7065b8-0168-44bf-9b12-39824b95d3c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:22 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-d6e69718-e61a-49e3-b85a-72b6dea9baf6 tempest-VolumesActionsTest-2130612724 None] Created volume successfully. Apr 21 20:59:22 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-66352d56-1f26-42ea-987d-2426efb06409 tempest-VolumesActionsTest-2130612724 None] Acquiring lock "cinder-47676a48-5daf-4f3b-a131-86341f339ecb-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:22 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-66352d56-1f26-42ea-987d-2426efb06409 tempest-VolumesActionsTest-2130612724 None] Lock "cinder-47676a48-5daf-4f3b-a131-86341f339ecb-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:22 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-66352d56-1f26-42ea-987d-2426efb06409 tempest-VolumesActionsTest-2130612724 None] Acquiring lock "cinder-quobyte-47676a48-5daf-4f3b-a131-86341f339ecb" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:22 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-66352d56-1f26-42ea-987d-2426efb06409 tempest-VolumesActionsTest-2130612724 None] Lock "cinder-quobyte-47676a48-5daf-4f3b-a131-86341f339ecb" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:22 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b35882f-10fd-469f-9095-f6fbacf068f4]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-66352d56-1f26-42ea-987d-2426efb06409 tempest-VolumesActionsTest-2130612724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-47676a48-5daf-4f3b-a131-86341f339ecb {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:22 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-47676a48-5daf-4f3b-a131-86341f339ecb Apr 21 20:59:22 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:23 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-66352d56-1f26-42ea-987d-2426efb06409 tempest-VolumesActionsTest-2130612724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-47676a48-5daf-4f3b-a131-86341f339ecb" returned: 0 in 0.440s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-66352d56-1f26-42ea-987d-2426efb06409 tempest-VolumesActionsTest-2130612724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-47676a48-5daf-4f3b-a131-86341f339ecb {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:23 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-47676a48-5daf-4f3b-a131-86341f339ecb Apr 21 20:59:23 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:23 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-66352d56-1f26-42ea-987d-2426efb06409 tempest-VolumesActionsTest-2130612724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-47676a48-5daf-4f3b-a131-86341f339ecb" returned: 0 in 0.394s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:23 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-66352d56-1f26-42ea-987d-2426efb06409 tempest-VolumesActionsTest-2130612724 None] Lock "cinder-quobyte-47676a48-5daf-4f3b-a131-86341f339ecb" released by "delete_volume" :: held 0.859s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:23 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-66352d56-1f26-42ea-987d-2426efb06409 tempest-VolumesActionsTest-2130612724 None] Created reservations ['a750fd2c-b654-4e9c-b276-b3db3c918afa', 'bf85b65c-abba-4ef7-8de3-6e549b920cb9', '3ecafe32-0944-4768-8f83-62bb9e64563e', 'f34b0a4e-c9af-4156-9086-574e45975c7a'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-66352d56-1f26-42ea-987d-2426efb06409 tempest-VolumesActionsTest-2130612724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-66352d56-1f26-42ea-987d-2426efb06409 tempest-VolumesActionsTest-2130612724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:23 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-66352d56-1f26-42ea-987d-2426efb06409 tempest-VolumesActionsTest-2130612724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:23 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-66352d56-1f26-42ea-987d-2426efb06409 tempest-VolumesActionsTest-2130612724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-66352d56-1f26-42ea-987d-2426efb06409 tempest-VolumesActionsTest-2130612724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-66352d56-1f26-42ea-987d-2426efb06409 tempest-VolumesActionsTest-2130612724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:23 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:59:23 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:24 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-66352d56-1f26-42ea-987d-2426efb06409 tempest-VolumesActionsTest-2130612724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.431s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:24 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-66352d56-1f26-42ea-987d-2426efb06409 tempest-VolumesActionsTest-2130612724 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:24 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-66352d56-1f26-42ea-987d-2426efb06409 tempest-VolumesActionsTest-2130612724 None] Deleted volume successfully. Apr 21 20:59:24 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-66352d56-1f26-42ea-987d-2426efb06409 tempest-VolumesActionsTest-2130612724 None] Lock "cinder-47676a48-5daf-4f3b-a131-86341f339ecb-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Flow 'volume_create_manager' (6a6dfe22-f386-4770-bf87-b84608b9cb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e659ec5f-a96d-474e-9701-da9dabd542b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e659ec5f-a96d-474e-9701-da9dabd542b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1285693762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280c6fae-8bcd-4670-a2e9-e92b14a06ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811ed6699eda470e86283511b84c5fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:31Z,use_quota=True,user_id='6a31dc69214342c0aa2e4520c1a79959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fed1eb6-6a06-4f74-a2d8-590726043c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fed1eb6-6a06-4f74-a2d8-590726043c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78ee03e-d3df-44e4-b8a1-c138aecce15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78ee03e-d3df-44e4-b8a1-c138aecce15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '280c6fae-8bcd-4670-a2e9-e92b14a06ba7', 'volume_name': 'volume-280c6fae-8bcd-4670-a2e9-e92b14a06ba7', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ffd9009-45b4-4102-860b-c83c51c01d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ffd9009-45b4-4102-860b-c83c51c01d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01415fe-75cd-488f-9a02-c938413cdde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:31 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Volume 280c6fae-8bcd-4670-a2e9-e92b14a06ba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-280c6fae-8bcd-4670-a2e9-e92b14a06ba7', 'volume_size': 1} Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1285693762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280c6fae-8bcd-4670-a2e9-e92b14a06ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811ed6699eda470e86283511b84c5fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:31Z,use_quota=True,user_id='6a31dc69214342c0aa2e4520c1a79959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Creating volume 280c6fae-8bcd-4670-a2e9-e92b14a06ba7 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:31 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-280c6fae-8bcd-4670-a2e9-e92b14a06ba7 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:31 devstack sudo[89524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-280c6fae-8bcd-4670-a2e9-e92b14a06ba7 1073741824 Apr 21 20:59:31 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:31 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-280c6fae-8bcd-4670-a2e9-e92b14a06ba7 1073741824" returned: 0 in 0.465s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-280c6fae-8bcd-4670-a2e9-e92b14a06ba7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:31 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-280c6fae-8bcd-4670-a2e9-e92b14a06ba7 Apr 21 20:59:31 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:32 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-280c6fae-8bcd-4670-a2e9-e92b14a06ba7" returned: 0 in 0.395s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01415fe-75cd-488f-9a02-c938413cdde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-280c6fae-8bcd-4670-a2e9-e92b14a06ba7', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8858a3b-fc95-4535-b269-695105b412f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:32 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Volume volume-280c6fae-8bcd-4670-a2e9-e92b14a06ba7 (280c6fae-8bcd-4670-a2e9-e92b14a06ba7): created successfully Apr 21 20:59:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8858a3b-fc95-4535-b269-695105b412f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Flow 'volume_create_manager' (6a6dfe22-f386-4770-bf87-b84608b9cb9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:32 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-de35a43b-ac38-4b25-a7ae-271ebe068bac tempest-VolumesTransfersV355Test-1167437887 None] Created volume successfully. Apr 21 20:59:33 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-4e291b3b-cd93-4d96-a184-484bf1369bee tempest-VolumesTransfersV355Test-1540496970 None] Transfer volume completed successfully. Apr 21 20:59:34 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8e3362ea-21dc-40af-b545-66421c404c21 tempest-VolumesTransfersV355Test-823659001 None] Acquiring lock "cinder-280c6fae-8bcd-4670-a2e9-e92b14a06ba7-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:34 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8e3362ea-21dc-40af-b545-66421c404c21 tempest-VolumesTransfersV355Test-823659001 None] Lock "cinder-280c6fae-8bcd-4670-a2e9-e92b14a06ba7-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:34 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8e3362ea-21dc-40af-b545-66421c404c21 tempest-VolumesTransfersV355Test-823659001 None] Acquiring lock "cinder-quobyte-280c6fae-8bcd-4670-a2e9-e92b14a06ba7" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:34 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8e3362ea-21dc-40af-b545-66421c404c21 tempest-VolumesTransfersV355Test-823659001 None] Lock "cinder-quobyte-280c6fae-8bcd-4670-a2e9-e92b14a06ba7" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:34 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[93188006-09f2-414a-8c27-a203bc487443]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8e3362ea-21dc-40af-b545-66421c404c21 tempest-VolumesTransfersV355Test-823659001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-280c6fae-8bcd-4670-a2e9-e92b14a06ba7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:34 devstack sudo[89532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-280c6fae-8bcd-4670-a2e9-e92b14a06ba7 Apr 21 20:59:34 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:34 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8e3362ea-21dc-40af-b545-66421c404c21 tempest-VolumesTransfersV355Test-823659001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-280c6fae-8bcd-4670-a2e9-e92b14a06ba7" returned: 0 in 0.444s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8e3362ea-21dc-40af-b545-66421c404c21 tempest-VolumesTransfersV355Test-823659001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-280c6fae-8bcd-4670-a2e9-e92b14a06ba7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:34 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-280c6fae-8bcd-4670-a2e9-e92b14a06ba7 Apr 21 20:59:34 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:35 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8e3362ea-21dc-40af-b545-66421c404c21 tempest-VolumesTransfersV355Test-823659001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-280c6fae-8bcd-4670-a2e9-e92b14a06ba7" returned: 0 in 0.377s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8e3362ea-21dc-40af-b545-66421c404c21 tempest-VolumesTransfersV355Test-823659001 None] Lock "cinder-quobyte-280c6fae-8bcd-4670-a2e9-e92b14a06ba7" released by "delete_volume" :: held 0.847s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-8e3362ea-21dc-40af-b545-66421c404c21 tempest-VolumesTransfersV355Test-823659001 None] Created reservations ['fd49c94e-ac5c-49b1-8f2f-21400c954ac6', 'a7156517-1f67-484e-8eb8-b2d9da40e7e5', 'c2d0b54b-4f83-471d-9b74-fe089c555eda', 'c96ccb39-b678-4d5e-a31f-dfbaad44fb08'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8e3362ea-21dc-40af-b545-66421c404c21 tempest-VolumesTransfersV355Test-823659001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8e3362ea-21dc-40af-b545-66421c404c21 tempest-VolumesTransfersV355Test-823659001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8e3362ea-21dc-40af-b545-66421c404c21 tempest-VolumesTransfersV355Test-823659001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8e3362ea-21dc-40af-b545-66421c404c21 tempest-VolumesTransfersV355Test-823659001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8e3362ea-21dc-40af-b545-66421c404c21 tempest-VolumesTransfersV355Test-823659001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8e3362ea-21dc-40af-b545-66421c404c21 tempest-VolumesTransfersV355Test-823659001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:35 devstack sudo[89540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:59:35 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:35 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8e3362ea-21dc-40af-b545-66421c404c21 tempest-VolumesTransfersV355Test-823659001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.406s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-8e3362ea-21dc-40af-b545-66421c404c21 tempest-VolumesTransfersV355Test-823659001 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:35 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-8e3362ea-21dc-40af-b545-66421c404c21 tempest-VolumesTransfersV355Test-823659001 None] Deleted volume successfully. Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8e3362ea-21dc-40af-b545-66421c404c21 tempest-VolumesTransfersV355Test-823659001 None] Lock "cinder-280c6fae-8bcd-4670-a2e9-e92b14a06ba7-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Flow 'volume_create_manager' (15d7baf7-c2a7-4077-9f3f-2489442645c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2340f0-5c6f-4273-8a1b-62e082d005e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2340f0-5c6f-4273-8a1b-62e082d005e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-562699148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46f086d-aa66-4458-83ec-f51dab8304e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811ed6699eda470e86283511b84c5fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:36Z,use_quota=True,user_id='6a31dc69214342c0aa2e4520c1a79959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25c2dff-6a55-428b-97c4-9f49543eaee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25c2dff-6a55-428b-97c4-9f49543eaee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e91fe2-e942-43eb-b225-2de457792020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e91fe2-e942-43eb-b225-2de457792020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f46f086d-aa66-4458-83ec-f51dab8304e4', 'volume_name': 'volume-f46f086d-aa66-4458-83ec-f51dab8304e4', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8394d70-da57-4e74-8334-8bb71c38aeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8394d70-da57-4e74-8334-8bb71c38aeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbbe770-723d-4c12-886e-a6a365c95039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:35 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Volume f46f086d-aa66-4458-83ec-f51dab8304e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f46f086d-aa66-4458-83ec-f51dab8304e4', 'volume_size': 1} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-562699148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46f086d-aa66-4458-83ec-f51dab8304e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811ed6699eda470e86283511b84c5fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:36Z,use_quota=True,user_id='6a31dc69214342c0aa2e4520c1a79959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Creating volume f46f086d-aa66-4458-83ec-f51dab8304e4 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:35 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:59:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f46f086d-aa66-4458-83ec-f51dab8304e4 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:35 devstack sudo[89543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f46f086d-aa66-4458-83ec-f51dab8304e4 1073741824 Apr 21 20:59:35 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:36 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f46f086d-aa66-4458-83ec-f51dab8304e4 1073741824" returned: 0 in 0.449s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f46f086d-aa66-4458-83ec-f51dab8304e4 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:36 devstack sudo[89548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f46f086d-aa66-4458-83ec-f51dab8304e4 Apr 21 20:59:36 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:36 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f46f086d-aa66-4458-83ec-f51dab8304e4" returned: 0 in 0.388s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:36 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbbe770-723d-4c12-886e-a6a365c95039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f46f086d-aa66-4458-83ec-f51dab8304e4', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91351b04-1e5f-4fac-b63a-ca2f7500dbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:36 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Volume volume-f46f086d-aa66-4458-83ec-f51dab8304e4 (f46f086d-aa66-4458-83ec-f51dab8304e4): created successfully Apr 21 20:59:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91351b04-1e5f-4fac-b63a-ca2f7500dbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:36 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Flow 'volume_create_manager' (15d7baf7-c2a7-4077-9f3f-2489442645c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:36 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-f0348735-67b8-4769-9062-4773eee5f15d tempest-VolumesTransfersV355Test-1167437887 None] Created volume successfully. Apr 21 20:59:37 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b2ca7441-fe2d-474d-b8a1-f8804e18b8a7 tempest-VolumesTransfersV355Test-823659001 None] Acquiring lock "cinder-f46f086d-aa66-4458-83ec-f51dab8304e4-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:37 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b2ca7441-fe2d-474d-b8a1-f8804e18b8a7 tempest-VolumesTransfersV355Test-823659001 None] Lock "cinder-f46f086d-aa66-4458-83ec-f51dab8304e4-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:37 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b2ca7441-fe2d-474d-b8a1-f8804e18b8a7 tempest-VolumesTransfersV355Test-823659001 None] Acquiring lock "cinder-quobyte-f46f086d-aa66-4458-83ec-f51dab8304e4" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:37 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b2ca7441-fe2d-474d-b8a1-f8804e18b8a7 tempest-VolumesTransfersV355Test-823659001 None] Lock "cinder-quobyte-f46f086d-aa66-4458-83ec-f51dab8304e4" acquired by "delete_volume" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:37 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b0ab87-e353-460c-9d2f-28a9276888cd]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b2ca7441-fe2d-474d-b8a1-f8804e18b8a7 tempest-VolumesTransfersV355Test-823659001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f46f086d-aa66-4458-83ec-f51dab8304e4 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:37 devstack sudo[89557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f46f086d-aa66-4458-83ec-f51dab8304e4 Apr 21 20:59:37 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:37 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b2ca7441-fe2d-474d-b8a1-f8804e18b8a7 tempest-VolumesTransfersV355Test-823659001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f46f086d-aa66-4458-83ec-f51dab8304e4" returned: 0 in 0.435s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b2ca7441-fe2d-474d-b8a1-f8804e18b8a7 tempest-VolumesTransfersV355Test-823659001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f46f086d-aa66-4458-83ec-f51dab8304e4 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:37 devstack sudo[89562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f46f086d-aa66-4458-83ec-f51dab8304e4 Apr 21 20:59:37 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:37 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b2ca7441-fe2d-474d-b8a1-f8804e18b8a7 tempest-VolumesTransfersV355Test-823659001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f46f086d-aa66-4458-83ec-f51dab8304e4" returned: 0 in 0.380s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:37 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b2ca7441-fe2d-474d-b8a1-f8804e18b8a7 tempest-VolumesTransfersV355Test-823659001 None] Lock "cinder-quobyte-f46f086d-aa66-4458-83ec-f51dab8304e4" released by "delete_volume" :: held 0.842s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:37 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-b2ca7441-fe2d-474d-b8a1-f8804e18b8a7 tempest-VolumesTransfersV355Test-823659001 None] Created reservations ['71c2b786-b9c9-49c9-9710-df30a3375ab9', 'c0138def-660c-407c-9e8f-53162ede7a4e', '22eead37-7151-40e3-af9a-bbd56f358fa9', 'e0c74e49-9129-4ed8-bdc4-031fb3894ea8'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b2ca7441-fe2d-474d-b8a1-f8804e18b8a7 tempest-VolumesTransfersV355Test-823659001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b2ca7441-fe2d-474d-b8a1-f8804e18b8a7 tempest-VolumesTransfersV355Test-823659001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:37 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b2ca7441-fe2d-474d-b8a1-f8804e18b8a7 tempest-VolumesTransfersV355Test-823659001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:37 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b2ca7441-fe2d-474d-b8a1-f8804e18b8a7 tempest-VolumesTransfersV355Test-823659001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b2ca7441-fe2d-474d-b8a1-f8804e18b8a7 tempest-VolumesTransfersV355Test-823659001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b2ca7441-fe2d-474d-b8a1-f8804e18b8a7 tempest-VolumesTransfersV355Test-823659001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:38 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:59:38 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:38 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b2ca7441-fe2d-474d-b8a1-f8804e18b8a7 tempest-VolumesTransfersV355Test-823659001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.469s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:38 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-b2ca7441-fe2d-474d-b8a1-f8804e18b8a7 tempest-VolumesTransfersV355Test-823659001 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:38 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-b2ca7441-fe2d-474d-b8a1-f8804e18b8a7 tempest-VolumesTransfersV355Test-823659001 None] Deleted volume successfully. Apr 21 20:59:38 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b2ca7441-fe2d-474d-b8a1-f8804e18b8a7 tempest-VolumesTransfersV355Test-823659001 None] Lock "cinder-f46f086d-aa66-4458-83ec-f51dab8304e4-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Flow 'volume_create_manager' (4878113f-6e45-4615-b9d1-ec801c625d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ff3d4b-d6e0-4bf8-80ed-b0671a3a6481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ff3d4b-d6e0-4bf8-80ed-b0671a3a6481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1930024178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=679f70e7-09ea-4003-9f6d-fc5ba1a289ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780035433cc94b03990780a9a59727da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:41Z,use_quota=True,user_id='2e30aba36a5f4d26af2c79524d3f5864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c68e06-5bb0-4dc2-bee5-786193c22bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c68e06-5bb0-4dc2-bee5-786193c22bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fd033c-3495-4734-bebb-b1992ea36cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fd033c-3495-4734-bebb-b1992ea36cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '679f70e7-09ea-4003-9f6d-fc5ba1a289ea', 'volume_name': 'volume-679f70e7-09ea-4003-9f6d-fc5ba1a289ea', 'volume_size': 2}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ebcc743-3f3f-4209-8cb8-5dbef6b1fcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ebcc743-3f3f-4209-8cb8-5dbef6b1fcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a347b7e6-fd87-4dbb-b59e-1b0b32049741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:41 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Volume 679f70e7-09ea-4003-9f6d-fc5ba1a289ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-679f70e7-09ea-4003-9f6d-fc5ba1a289ea', 'volume_size': 2} Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1930024178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=679f70e7-09ea-4003-9f6d-fc5ba1a289ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780035433cc94b03990780a9a59727da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:41Z,use_quota=True,user_id='2e30aba36a5f4d26af2c79524d3f5864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Creating volume 679f70e7-09ea-4003-9f6d-fc5ba1a289ea {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:41 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-679f70e7-09ea-4003-9f6d-fc5ba1a289ea 2147483648 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:41 devstack sudo[89569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-679f70e7-09ea-4003-9f6d-fc5ba1a289ea 2147483648 Apr 21 20:59:41 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:41 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-679f70e7-09ea-4003-9f6d-fc5ba1a289ea 2147483648" returned: 0 in 0.473s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-679f70e7-09ea-4003-9f6d-fc5ba1a289ea {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:41 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-679f70e7-09ea-4003-9f6d-fc5ba1a289ea Apr 21 20:59:41 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:42 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-679f70e7-09ea-4003-9f6d-fc5ba1a289ea" returned: 0 in 0.406s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:42 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:42 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a347b7e6-fd87-4dbb-b59e-1b0b32049741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-679f70e7-09ea-4003-9f6d-fc5ba1a289ea', 'volume_size': 2}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:42 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e78d937-04f6-4423-9915-47d1882d1848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:42 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Volume volume-679f70e7-09ea-4003-9f6d-fc5ba1a289ea (679f70e7-09ea-4003-9f6d-fc5ba1a289ea): created successfully Apr 21 20:59:42 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e78d937-04f6-4423-9915-47d1882d1848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:42 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Flow 'volume_create_manager' (4878113f-6e45-4615-b9d1-ec801c625d95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:42 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-354b62e0-865f-4ce3-b008-d51e042b4fb7 tempest-VolumesCloneNegativeTest-537903992 None] Created volume successfully. Apr 21 20:59:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-621b8b1a-5c6a-401e-a72f-ea0ce4ab0baf tempest-VolumesCloneNegativeTest-537903992 None] Acquiring lock "cinder-679f70e7-09ea-4003-9f6d-fc5ba1a289ea-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-621b8b1a-5c6a-401e-a72f-ea0ce4ab0baf tempest-VolumesCloneNegativeTest-537903992 None] Lock "cinder-679f70e7-09ea-4003-9f6d-fc5ba1a289ea-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-621b8b1a-5c6a-401e-a72f-ea0ce4ab0baf tempest-VolumesCloneNegativeTest-537903992 None] Acquiring lock "cinder-quobyte-679f70e7-09ea-4003-9f6d-fc5ba1a289ea" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-621b8b1a-5c6a-401e-a72f-ea0ce4ab0baf tempest-VolumesCloneNegativeTest-537903992 None] Lock "cinder-quobyte-679f70e7-09ea-4003-9f6d-fc5ba1a289ea" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:43 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5b5697-4bc4-4449-8261-a7bd52f19898]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-621b8b1a-5c6a-401e-a72f-ea0ce4ab0baf tempest-VolumesCloneNegativeTest-537903992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-679f70e7-09ea-4003-9f6d-fc5ba1a289ea {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:43 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-679f70e7-09ea-4003-9f6d-fc5ba1a289ea Apr 21 20:59:43 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:43 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-621b8b1a-5c6a-401e-a72f-ea0ce4ab0baf tempest-VolumesCloneNegativeTest-537903992 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-679f70e7-09ea-4003-9f6d-fc5ba1a289ea" returned: 0 in 0.477s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-621b8b1a-5c6a-401e-a72f-ea0ce4ab0baf tempest-VolumesCloneNegativeTest-537903992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-679f70e7-09ea-4003-9f6d-fc5ba1a289ea {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:43 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-679f70e7-09ea-4003-9f6d-fc5ba1a289ea Apr 21 20:59:43 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:44 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-621b8b1a-5c6a-401e-a72f-ea0ce4ab0baf tempest-VolumesCloneNegativeTest-537903992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-679f70e7-09ea-4003-9f6d-fc5ba1a289ea" returned: 0 in 0.400s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:44 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-621b8b1a-5c6a-401e-a72f-ea0ce4ab0baf tempest-VolumesCloneNegativeTest-537903992 None] Lock "cinder-quobyte-679f70e7-09ea-4003-9f6d-fc5ba1a289ea" released by "delete_volume" :: held 0.898s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:44 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-621b8b1a-5c6a-401e-a72f-ea0ce4ab0baf tempest-VolumesCloneNegativeTest-537903992 None] Created reservations ['361564f5-6add-46dc-b4c4-a8ddb32f36fa', '0d570fd8-6670-4046-91fd-f0aeb44bfc3b', '70e9d3bf-7095-4f5b-8d0d-e744a0b1bd0e', '92ec1c74-a94c-4b84-aa2d-3ec4716b1bcd'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-621b8b1a-5c6a-401e-a72f-ea0ce4ab0baf tempest-VolumesCloneNegativeTest-537903992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-621b8b1a-5c6a-401e-a72f-ea0ce4ab0baf tempest-VolumesCloneNegativeTest-537903992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:44 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-621b8b1a-5c6a-401e-a72f-ea0ce4ab0baf tempest-VolumesCloneNegativeTest-537903992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:44 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-621b8b1a-5c6a-401e-a72f-ea0ce4ab0baf tempest-VolumesCloneNegativeTest-537903992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-621b8b1a-5c6a-401e-a72f-ea0ce4ab0baf tempest-VolumesCloneNegativeTest-537903992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-621b8b1a-5c6a-401e-a72f-ea0ce4ab0baf tempest-VolumesCloneNegativeTest-537903992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:44 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:59:44 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:44 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-621b8b1a-5c6a-401e-a72f-ea0ce4ab0baf tempest-VolumesCloneNegativeTest-537903992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.443s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:44 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-621b8b1a-5c6a-401e-a72f-ea0ce4ab0baf tempest-VolumesCloneNegativeTest-537903992 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:44 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-621b8b1a-5c6a-401e-a72f-ea0ce4ab0baf tempest-VolumesCloneNegativeTest-537903992 None] Deleted volume successfully. Apr 21 20:59:44 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-621b8b1a-5c6a-401e-a72f-ea0ce4ab0baf tempest-VolumesCloneNegativeTest-537903992 None] Lock "cinder-679f70e7-09ea-4003-9f6d-fc5ba1a289ea-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Flow 'volume_create_manager' (feaf31f6-33b8-4c6a-a5a0-d7f7c088e0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e569b7-73d1-4ebd-96b2-1a580d6ddf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e569b7-73d1-4ebd-96b2-1a580d6ddf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1802731738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db9227b-99ed-4484-84ab-f5edbcfd289c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d635049a33945209e9bb964abfdce0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:46Z,use_quota=True,user_id='278147bc76ee436d93cd608c53fc3058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088f50c6-6c8a-44d6-aeb3-319380851c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088f50c6-6c8a-44d6-aeb3-319380851c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5ae97e-2a45-4ade-bb59-b2ad2a456166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5ae97e-2a45-4ade-bb59-b2ad2a456166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5db9227b-99ed-4484-84ab-f5edbcfd289c', 'volume_name': 'volume-5db9227b-99ed-4484-84ab-f5edbcfd289c', 'volume_size': 2}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228ec4ab-6040-4893-83e3-4e8752ee61e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228ec4ab-6040-4893-83e3-4e8752ee61e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3a4f85-003c-4ec0-8558-fe090519cc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:46 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Volume 5db9227b-99ed-4484-84ab-f5edbcfd289c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5db9227b-99ed-4484-84ab-f5edbcfd289c', 'volume_size': 2} Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1802731738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db9227b-99ed-4484-84ab-f5edbcfd289c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d635049a33945209e9bb964abfdce0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:46Z,use_quota=True,user_id='278147bc76ee436d93cd608c53fc3058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Creating volume 5db9227b-99ed-4484-84ab-f5edbcfd289c {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:46 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c 2147483648 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:46 devstack sudo[89588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c 2147483648 Apr 21 20:59:46 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:46 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c 2147483648" returned: 0 in 0.457s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:46 devstack sudo[89593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c Apr 21 20:59:46 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:47 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c" returned: 0 in 0.381s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:47 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3a4f85-003c-4ec0-8558-fe090519cc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5db9227b-99ed-4484-84ab-f5edbcfd289c', 'volume_size': 2}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:47 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b20c237f-17c6-4838-9726-bca2bd639391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Volume volume-5db9227b-99ed-4484-84ab-f5edbcfd289c (5db9227b-99ed-4484-84ab-f5edbcfd289c): created successfully Apr 21 20:59:47 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b20c237f-17c6-4838-9726-bca2bd639391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:47 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Flow 'volume_create_manager' (feaf31f6-33b8-4c6a-a5a0-d7f7c088e0c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:47 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-faa74e37-bab8-4aaf-9ea8-b878b840f49e tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Created volume successfully. Apr 21 20:59:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-32b8c1fd-e1d3-40f9-8c3d-be689d8047fb tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-32b8c1fd-e1d3-40f9-8c3d-be689d8047fb tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-32b8c1fd-e1d3-40f9-8c3d-be689d8047fb tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Creating offline snapshot af043083-79fd-496a-8249-b12058c36669 of volume 5db9227b-99ed-4484-84ab-f5edbcfd289c {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:59:47 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dc37ad-c106-4137-a971-ca4e62418565]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-32b8c1fd-e1d3-40f9-8c3d-be689d8047fb tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:47 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c Apr 21 20:59:47 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:47 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-32b8c1fd-e1d3-40f9-8c3d-be689d8047fb tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c" returned: 0 in 0.436s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-32b8c1fd-e1d3-40f9-8c3d-be689d8047fb tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.af043083-79fd-496a-8249-b12058c36669 2G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:48 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.af043083-79fd-496a-8249-b12058c36669 2G Apr 21 20:59:48 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:48 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-32b8c1fd-e1d3-40f9-8c3d-be689d8047fb tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.af043083-79fd-496a-8249-b12058c36669 2G" returned: 0 in 0.448s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-32b8c1fd-e1d3-40f9-8c3d-be689d8047fb tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5db9227b-99ed-4484-84ab-f5edbcfd289c -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.af043083-79fd-496a-8249-b12058c36669 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:48 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5db9227b-99ed-4484-84ab-f5edbcfd289c -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.af043083-79fd-496a-8249-b12058c36669 Apr 21 20:59:48 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:48 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-32b8c1fd-e1d3-40f9-8c3d-be689d8047fb tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5db9227b-99ed-4484-84ab-f5edbcfd289c -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.af043083-79fd-496a-8249-b12058c36669" returned: 0 in 0.397s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:48 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-32b8c1fd-e1d3-40f9-8c3d-be689d8047fb tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.af043083-79fd-496a-8249-b12058c36669 is being set with open permissions: ugo+rw Apr 21 20:59:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-32b8c1fd-e1d3-40f9-8c3d-be689d8047fb tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.af043083-79fd-496a-8249-b12058c36669 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:48 devstack sudo[89611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.af043083-79fd-496a-8249-b12058c36669 Apr 21 20:59:48 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:49 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-32b8c1fd-e1d3-40f9-8c3d-be689d8047fb tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.af043083-79fd-496a-8249-b12058c36669" returned: 0 in 0.397s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-32b8c1fd-e1d3-40f9-8c3d-be689d8047fb tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:49 devstack sudo[89615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.info Apr 21 20:59:49 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:49 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-32b8c1fd-e1d3-40f9-8c3d-be689d8047fb tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.info" returned: 0 in 0.404s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:49 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-32b8c1fd-e1d3-40f9-8c3d-be689d8047fb tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.info is being set with open permissions: ugo+rw Apr 21 20:59:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-32b8c1fd-e1d3-40f9-8c3d-be689d8047fb tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:49 devstack sudo[89618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.info Apr 21 20:59:49 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:50 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-32b8c1fd-e1d3-40f9-8c3d-be689d8047fb tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.info" returned: 0 in 0.396s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-32b8c1fd-e1d3-40f9-8c3d-be689d8047fb tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.530s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:50 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-32b8c1fd-e1d3-40f9-8c3d-be689d8047fb tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Create snapshot completed successfully Apr 21 20:59:50 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-20a08316-8348-47b9-9761-af10c17d1782 tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Acquiring lock "cinder-af043083-79fd-496a-8249-b12058c36669-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:50 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-20a08316-8348-47b9-9761-af10c17d1782 tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Lock "cinder-af043083-79fd-496a-8249-b12058c36669-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:50 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-20a08316-8348-47b9-9761-af10c17d1782 tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Acquiring lock "cinder-quobyte-5db9227b-99ed-4484-84ab-f5edbcfd289c" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:50 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-20a08316-8348-47b9-9761-af10c17d1782 tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Lock "cinder-quobyte-5db9227b-99ed-4484-84ab-f5edbcfd289c" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:50 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-20a08316-8348-47b9-9761-af10c17d1782 tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Acquiring lock "cinder-quobyte-af043083-79fd-496a-8249-b12058c36669" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:50 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-20a08316-8348-47b9-9761-af10c17d1782 tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Lock "cinder-quobyte-af043083-79fd-496a-8249-b12058c36669" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:50 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-20a08316-8348-47b9-9761-af10c17d1782 tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Deleting offline snapshot af043083-79fd-496a-8249-b12058c36669 of volume 5db9227b-99ed-4484-84ab-f5edbcfd289c {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:59:50 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-20a08316-8348-47b9-9761-af10c17d1782 tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] snapshot_file for this snap is: volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.af043083-79fd-496a-8249-b12058c36669 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:59:50 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50464c5-3299-48a3-8b03-0f89ccf6867a]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-20a08316-8348-47b9-9761-af10c17d1782 tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.af043083-79fd-496a-8249-b12058c36669 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:50 devstack sudo[89622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.af043083-79fd-496a-8249-b12058c36669 Apr 21 20:59:50 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:51 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-20a08316-8348-47b9-9761-af10c17d1782 tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.af043083-79fd-496a-8249-b12058c36669" returned: 0 in 0.445s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:51 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-20a08316-8348-47b9-9761-af10c17d1782 tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5db9227b-99ed-4484-84ab-f5edbcfd289c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:59:51 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd516eee-7551-4647-bce4-cfcdc14af724]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-20a08316-8348-47b9-9761-af10c17d1782 tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:51 devstack sudo[89627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c Apr 21 20:59:51 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:51 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-20a08316-8348-47b9-9761-af10c17d1782 tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c" returned: 0 in 0.444s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-20a08316-8348-47b9-9761-af10c17d1782 tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.af043083-79fd-496a-8249-b12058c36669 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:51 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.af043083-79fd-496a-8249-b12058c36669 Apr 21 20:59:51 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:52 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-20a08316-8348-47b9-9761-af10c17d1782 tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.af043083-79fd-496a-8249-b12058c36669" returned: 0 in 0.409s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-20a08316-8348-47b9-9761-af10c17d1782 tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.af043083-79fd-496a-8249-b12058c36669 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:52 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.af043083-79fd-496a-8249-b12058c36669 Apr 21 20:59:52 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:52 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-20a08316-8348-47b9-9761-af10c17d1782 tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c.af043083-79fd-496a-8249-b12058c36669" returned: 0 in 0.376s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-20a08316-8348-47b9-9761-af10c17d1782 tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Lock "cinder-quobyte-af043083-79fd-496a-8249-b12058c36669" released by "_delete_snapshot" :: held 1.722s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-20a08316-8348-47b9-9761-af10c17d1782 tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Lock "cinder-quobyte-5db9227b-99ed-4484-84ab-f5edbcfd289c" released by "delete_snapshot" :: held 1.733s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:52 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-20a08316-8348-47b9-9761-af10c17d1782 tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Created reservations ['32cee9cb-556c-4a62-b7fe-61d94272e81a', '827d6565-613e-4388-8c40-4ed9414098ab', '9fddea89-e662-4369-bfea-0b96ce6bee10', 'b8644a30-8d55-4239-b265-a8fab0d34754'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:52 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-20a08316-8348-47b9-9761-af10c17d1782 tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Delete snapshot completed successfully. Apr 21 20:59:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-20a08316-8348-47b9-9761-af10c17d1782 tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Lock "cinder-af043083-79fd-496a-8249-b12058c36669-delete_snapshot" released by "delete_snapshot" :: held 1.807s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e6b9195c-f2df-4b14-b2b0-dd4bbb2482bf tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Acquiring lock "cinder-5db9227b-99ed-4484-84ab-f5edbcfd289c-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e6b9195c-f2df-4b14-b2b0-dd4bbb2482bf tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Lock "cinder-5db9227b-99ed-4484-84ab-f5edbcfd289c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e6b9195c-f2df-4b14-b2b0-dd4bbb2482bf tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Acquiring lock "cinder-quobyte-5db9227b-99ed-4484-84ab-f5edbcfd289c" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e6b9195c-f2df-4b14-b2b0-dd4bbb2482bf tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Lock "cinder-quobyte-5db9227b-99ed-4484-84ab-f5edbcfd289c" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:52 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[239ac954-f036-41e6-82fc-88d603c7a75d]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e6b9195c-f2df-4b14-b2b0-dd4bbb2482bf tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:52 devstack sudo[89640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c Apr 21 20:59:52 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:53 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e6b9195c-f2df-4b14-b2b0-dd4bbb2482bf tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c" returned: 0 in 0.436s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e6b9195c-f2df-4b14-b2b0-dd4bbb2482bf tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:53 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c Apr 21 20:59:53 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:53 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e6b9195c-f2df-4b14-b2b0-dd4bbb2482bf tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5db9227b-99ed-4484-84ab-f5edbcfd289c" returned: 0 in 0.382s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:53 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e6b9195c-f2df-4b14-b2b0-dd4bbb2482bf tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Lock "cinder-quobyte-5db9227b-99ed-4484-84ab-f5edbcfd289c" released by "delete_volume" :: held 0.845s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:53 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-e6b9195c-f2df-4b14-b2b0-dd4bbb2482bf tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Created reservations ['8149f5df-fab9-485f-a281-47ecdd89fd10', 'b7423877-0681-47e8-8bca-aa2b913d7266', '8360521f-3561-4747-9300-dc3e4474149f', '4b63063b-2482-46b2-82fc-fd4a9a67d90b'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e6b9195c-f2df-4b14-b2b0-dd4bbb2482bf tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e6b9195c-f2df-4b14-b2b0-dd4bbb2482bf tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e6b9195c-f2df-4b14-b2b0-dd4bbb2482bf tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e6b9195c-f2df-4b14-b2b0-dd4bbb2482bf tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e6b9195c-f2df-4b14-b2b0-dd4bbb2482bf tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e6b9195c-f2df-4b14-b2b0-dd4bbb2482bf tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:53 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:59:53 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:53 devstack cinder-volume[81957]: DEBUG oslo_service.periodic_task [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81957) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:59:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:53 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 20:59:53 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:54 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e6b9195c-f2df-4b14-b2b0-dd4bbb2482bf tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.425s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:54 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-e6b9195c-f2df-4b14-b2b0-dd4bbb2482bf tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:54 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-e6b9195c-f2df-4b14-b2b0-dd4bbb2482bf tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Deleted volume successfully. Apr 21 20:59:54 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:SELECT=93,cinder:UPDATE=139,cinder:DELETE=10,cinder:INSERT=32 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:59:54 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-e6b9195c-f2df-4b14-b2b0-dd4bbb2482bf tempest-VolumesSnapshotNegativeTestJSON-1038824122 None] Lock "cinder-5db9227b-99ed-4484-84ab-f5edbcfd289c-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:54 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.454s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:54 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:SELECT=82,cinder:UPDATE=102,cinder:INSERT=25,cinder:DELETE=11 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Flow 'volume_create_manager' (d2a443be-3625-48c0-a431-a07105374671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea688889-2dc1-4570-ae03-ffd731f7eda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea688889-2dc1-4570-ae03-ffd731f7eda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-912868812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7deb57d-3c47-4957-8d0f-e76c47aee9bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce2054fef40b451a91ecbc2f8592de3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:55Z,use_quota=True,user_id='b61f06379faf41b8a71183581bcd3d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4b0e62-83e2-414c-b541-ab27a2060b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4b0e62-83e2-414c-b541-ab27a2060b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec05a46-8c44-4b13-a264-125520b17ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec05a46-8c44-4b13-a264-125520b17ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7deb57d-3c47-4957-8d0f-e76c47aee9bb', 'volume_name': 'volume-f7deb57d-3c47-4957-8d0f-e76c47aee9bb', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e98bfc-fdaf-438b-b0c9-735a93759978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e98bfc-fdaf-438b-b0c9-735a93759978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ef57cc-a3c3-4754-ba4f-eb0ef77f5ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:55 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Volume f7deb57d-3c47-4957-8d0f-e76c47aee9bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7deb57d-3c47-4957-8d0f-e76c47aee9bb', 'volume_size': 1} Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-912868812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7deb57d-3c47-4957-8d0f-e76c47aee9bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce2054fef40b451a91ecbc2f8592de3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:55Z,use_quota=True,user_id='b61f06379faf41b8a71183581bcd3d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Creating volume f7deb57d-3c47-4957-8d0f-e76c47aee9bb {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:55 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f7deb57d-3c47-4957-8d0f-e76c47aee9bb 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:55 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f7deb57d-3c47-4957-8d0f-e76c47aee9bb 1073741824 Apr 21 20:59:55 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:55 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f7deb57d-3c47-4957-8d0f-e76c47aee9bb 1073741824" returned: 0 in 0.447s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f7deb57d-3c47-4957-8d0f-e76c47aee9bb {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:56 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f7deb57d-3c47-4957-8d0f-e76c47aee9bb Apr 21 20:59:56 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:56 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f7deb57d-3c47-4957-8d0f-e76c47aee9bb" returned: 0 in 0.389s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ef57cc-a3c3-4754-ba4f-eb0ef77f5ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7deb57d-3c47-4957-8d0f-e76c47aee9bb', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436361df-22ab-47b4-b587-f7c37ffb3a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:56 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Volume volume-f7deb57d-3c47-4957-8d0f-e76c47aee9bb (f7deb57d-3c47-4957-8d0f-e76c47aee9bb): created successfully Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436361df-22ab-47b4-b587-f7c37ffb3a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Flow 'volume_create_manager' (d2a443be-3625-48c0-a431-a07105374671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:56 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-e2e3e8b7-2208-47b7-983c-721045b54d7f tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Created volume successfully. Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Flow 'volume_create_manager' (85e52f15-a95b-436e-822f-8e39811b505b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec24502d-759f-49fb-a2fa-501d1cf8ebb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec24502d-759f-49fb-a2fa-501d1cf8ebb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2018923077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd41af8-c561-4d6b-953b-881339bb5640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce2054fef40b451a91ecbc2f8592de3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:57Z,use_quota=True,user_id='b61f06379faf41b8a71183581bcd3d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f7e3a2-9cd0-444d-a360-d76d8067948b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f7e3a2-9cd0-444d-a360-d76d8067948b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0a0673-2fad-4003-b2e0-3b24e5604ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0a0673-2fad-4003-b2e0-3b24e5604ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dd41af8-c561-4d6b-953b-881339bb5640', 'volume_name': 'volume-9dd41af8-c561-4d6b-953b-881339bb5640', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce1afa2-686f-49ef-85bc-2daadf2fb46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce1afa2-686f-49ef-85bc-2daadf2fb46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ca3c61-da80-4810-aaae-ca3a2e2fe086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:56 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Volume 9dd41af8-c561-4d6b-953b-881339bb5640: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dd41af8-c561-4d6b-953b-881339bb5640', 'volume_size': 1} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2018923077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd41af8-c561-4d6b-953b-881339bb5640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce2054fef40b451a91ecbc2f8592de3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:57Z,use_quota=True,user_id='b61f06379faf41b8a71183581bcd3d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Creating volume 9dd41af8-c561-4d6b-953b-881339bb5640 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:56 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd41af8-c561-4d6b-953b-881339bb5640 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:56 devstack sudo[89696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd41af8-c561-4d6b-953b-881339bb5640 1073741824 Apr 21 20:59:56 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Flow 'volume_create_manager' (c1103037-f4f8-43fa-8d10-423194c8ea7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16c6359-d8a2-48a6-b115-0bf0c90df0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16c6359-d8a2-48a6-b115-0bf0c90df0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-108887391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b63b445-d44a-4496-9590-2784be444f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce2054fef40b451a91ecbc2f8592de3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:57Z,use_quota=True,user_id='b61f06379faf41b8a71183581bcd3d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e2e5ac-ac2a-4cd1-8815-a448efa26202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e2e5ac-ac2a-4cd1-8815-a448efa26202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d282857-14d5-42c1-bf60-e59c2909364f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d282857-14d5-42c1-bf60-e59c2909364f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b63b445-d44a-4496-9590-2784be444f52', 'volume_name': 'volume-0b63b445-d44a-4496-9590-2784be444f52', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d460d4d5-42df-438e-b4d0-aa7a56dbeff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d460d4d5-42df-438e-b4d0-aa7a56dbeff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e596148d-e958-4221-8dbf-770c837b5b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:56 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Volume 0b63b445-d44a-4496-9590-2784be444f52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b63b445-d44a-4496-9590-2784be444f52', 'volume_size': 1} Apr 21 20:59:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Flow 'volume_create_manager' (e27ed4f8-86af-4263-b29e-a25d39233988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bed34a8-bbc6-4191-aaf0-8386e44cb68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bed34a8-bbc6-4191-aaf0-8386e44cb68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-634098639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd6d8e1-6578-4366-b77b-f458d769e310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce2054fef40b451a91ecbc2f8592de3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:57Z,use_quota=True,user_id='b61f06379faf41b8a71183581bcd3d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14607ab9-f7e8-4c80-b969-e114fd5f0d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14607ab9-f7e8-4c80-b969-e114fd5f0d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6bac7b1-eb6c-4d8b-9415-1ea731b7c8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6bac7b1-eb6c-4d8b-9415-1ea731b7c8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfd6d8e1-6578-4366-b77b-f458d769e310', 'volume_name': 'volume-bfd6d8e1-6578-4366-b77b-f458d769e310', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280318c6-cf08-43a5-bdb2-d2462399aaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280318c6-cf08-43a5-bdb2-d2462399aaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f02a9e8-265c-4073-846d-b576045f1168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:57 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Volume bfd6d8e1-6578-4366-b77b-f458d769e310: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfd6d8e1-6578-4366-b77b-f458d769e310', 'volume_size': 1} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Flow 'volume_create_manager' (25482ece-51dd-4da3-986b-dc6d5489c09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (484bebfc-56f4-41a0-9b0e-9072ed897203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (484bebfc-56f4-41a0-9b0e-9072ed897203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1688564401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4762cb6-7fea-4e2a-ba8c-312d47fdbea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce2054fef40b451a91ecbc2f8592de3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:57Z,use_quota=True,user_id='b61f06379faf41b8a71183581bcd3d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed3e172-db99-464f-9088-13a6155da075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed3e172-db99-464f-9088-13a6155da075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6efe4d2f-4752-45ce-895b-0b2acc1daba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6efe4d2f-4752-45ce-895b-0b2acc1daba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4762cb6-7fea-4e2a-ba8c-312d47fdbea8', 'volume_name': 'volume-b4762cb6-7fea-4e2a-ba8c-312d47fdbea8', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48eaa430-e7eb-4969-a062-3edaaefe3d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48eaa430-e7eb-4969-a062-3edaaefe3d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec115be7-9ff0-42da-bc9c-3f86c15b556c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:57 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Volume b4762cb6-7fea-4e2a-ba8c-312d47fdbea8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4762cb6-7fea-4e2a-ba8c-312d47fdbea8', 'volume_size': 1} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:57 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd41af8-c561-4d6b-953b-881339bb5640 1073741824" returned: 0 in 0.572s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd41af8-c561-4d6b-953b-881339bb5640 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:57 devstack sudo[89701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd41af8-c561-4d6b-953b-881339bb5640 Apr 21 20:59:57 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Flow 'volume_create_manager' (4ae2e768-6576-434a-884f-67fd6d8ab685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac46af9a-71b9-429d-9385-24bd0f52f947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac46af9a-71b9-429d-9385-24bd0f52f947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-559721367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ead59fa-a6d4-4f1f-92b9-dcd762131a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce2054fef40b451a91ecbc2f8592de3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:57Z,use_quota=True,user_id='b61f06379faf41b8a71183581bcd3d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b176619-cf39-4411-8b5a-ac75884758c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b176619-cf39-4411-8b5a-ac75884758c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6d9410-442e-45d5-93d4-21ad7c3df2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6d9410-442e-45d5-93d4-21ad7c3df2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ead59fa-a6d4-4f1f-92b9-dcd762131a2a', 'volume_name': 'volume-3ead59fa-a6d4-4f1f-92b9-dcd762131a2a', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f5f7ad-5580-4293-8a54-692b12ff693e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f5f7ad-5580-4293-8a54-692b12ff693e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632b202c-7979-4b57-a0c8-3bc81c388ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:57 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Volume 3ead59fa-a6d4-4f1f-92b9-dcd762131a2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ead59fa-a6d4-4f1f-92b9-dcd762131a2a', 'volume_size': 1} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:57 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd41af8-c561-4d6b-953b-881339bb5640" returned: 0 in 0.415s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.885s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-108887391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b63b445-d44a-4496-9590-2784be444f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce2054fef40b451a91ecbc2f8592de3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:57Z,use_quota=True,user_id='b61f06379faf41b8a71183581bcd3d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Creating volume 0b63b445-d44a-4496-9590-2784be444f52 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:57 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b63b445-d44a-4496-9590-2784be444f52 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ca3c61-da80-4810-aaae-ca3a2e2fe086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dd41af8-c561-4d6b-953b-881339bb5640', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a115e5-e13f-48af-952f-6aab4bcbb373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:57 devstack sudo[89704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b63b445-d44a-4496-9590-2784be444f52 1073741824 Apr 21 20:59:57 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:57 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Volume volume-9dd41af8-c561-4d6b-953b-881339bb5640 (9dd41af8-c561-4d6b-953b-881339bb5640): created successfully Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a115e5-e13f-48af-952f-6aab4bcbb373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:57 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Flow 'volume_create_manager' (85e52f15-a95b-436e-822f-8e39811b505b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:57 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-82bfc0c4-c33e-46ba-873c-1c4942dfe138 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Created volume successfully. Apr 21 20:59:58 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b63b445-d44a-4496-9590-2784be444f52 1073741824" returned: 0 in 0.501s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b63b445-d44a-4496-9590-2784be444f52 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:58 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b63b445-d44a-4496-9590-2784be444f52 Apr 21 20:59:58 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:58 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b63b445-d44a-4496-9590-2784be444f52" returned: 0 in 0.402s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.633s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-634098639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd6d8e1-6578-4366-b77b-f458d769e310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce2054fef40b451a91ecbc2f8592de3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:57Z,use_quota=True,user_id='b61f06379faf41b8a71183581bcd3d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Creating volume bfd6d8e1-6578-4366-b77b-f458d769e310 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:58 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:59:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bfd6d8e1-6578-4366-b77b-f458d769e310 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e596148d-e958-4221-8dbf-770c837b5b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b63b445-d44a-4496-9590-2784be444f52', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376fbd87-f90d-453f-8016-efe0a79c81f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:58 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bfd6d8e1-6578-4366-b77b-f458d769e310 1073741824 Apr 21 20:59:58 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:58 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Volume volume-0b63b445-d44a-4496-9590-2784be444f52 (0b63b445-d44a-4496-9590-2784be444f52): created successfully Apr 21 20:59:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376fbd87-f90d-453f-8016-efe0a79c81f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:58 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Flow 'volume_create_manager' (c1103037-f4f8-43fa-8d10-423194c8ea7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:58 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-73de277c-bf54-4da5-9bef-bafcf14b9625 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Created volume successfully. Apr 21 20:59:59 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bfd6d8e1-6578-4366-b77b-f458d769e310 1073741824" returned: 0 in 0.510s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bfd6d8e1-6578-4366-b77b-f458d769e310 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:59 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bfd6d8e1-6578-4366-b77b-f458d769e310 Apr 21 20:59:59 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:59 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bfd6d8e1-6578-4366-b77b-f458d769e310" returned: 0 in 0.392s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.380s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1688564401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4762cb6-7fea-4e2a-ba8c-312d47fdbea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce2054fef40b451a91ecbc2f8592de3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:57Z,use_quota=True,user_id='b61f06379faf41b8a71183581bcd3d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Creating volume b4762cb6-7fea-4e2a-ba8c-312d47fdbea8 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:59 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 20:59:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b4762cb6-7fea-4e2a-ba8c-312d47fdbea8 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f02a9e8-265c-4073-846d-b576045f1168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfd6d8e1-6578-4366-b77b-f458d769e310', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:59 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b4762cb6-7fea-4e2a-ba8c-312d47fdbea8 1073741824 Apr 21 20:59:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab6fc89c-336f-41b1-b063-8be5df1ea874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:59 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:59 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Volume volume-bfd6d8e1-6578-4366-b77b-f458d769e310 (bfd6d8e1-6578-4366-b77b-f458d769e310): created successfully Apr 21 20:59:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab6fc89c-336f-41b1-b063-8be5df1ea874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Flow 'volume_create_manager' (e27ed4f8-86af-4263-b29e-a25d39233988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:59 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-3646288e-47ab-4ee6-a98e-553b825cc653 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Created volume successfully. Apr 21 21:00:00 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b4762cb6-7fea-4e2a-ba8c-312d47fdbea8 1073741824" returned: 0 in 0.510s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b4762cb6-7fea-4e2a-ba8c-312d47fdbea8 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:00 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b4762cb6-7fea-4e2a-ba8c-312d47fdbea8 Apr 21 21:00:00 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:00 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b4762cb6-7fea-4e2a-ba8c-312d47fdbea8" returned: 0 in 0.418s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.158s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-559721367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ead59fa-a6d4-4f1f-92b9-dcd762131a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce2054fef40b451a91ecbc2f8592de3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:57Z,use_quota=True,user_id='b61f06379faf41b8a71183581bcd3d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Creating volume 3ead59fa-a6d4-4f1f-92b9-dcd762131a2a {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:00 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:00:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3ead59fa-a6d4-4f1f-92b9-dcd762131a2a 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec115be7-9ff0-42da-bc9c-3f86c15b556c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4762cb6-7fea-4e2a-ba8c-312d47fdbea8', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:00 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3ead59fa-a6d4-4f1f-92b9-dcd762131a2a 1073741824 Apr 21 21:00:00 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0423903-81a8-416f-86a5-9b165ccdc3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:00 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Volume volume-b4762cb6-7fea-4e2a-ba8c-312d47fdbea8 (b4762cb6-7fea-4e2a-ba8c-312d47fdbea8): created successfully Apr 21 21:00:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0423903-81a8-416f-86a5-9b165ccdc3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Flow 'volume_create_manager' (25482ece-51dd-4da3-986b-dc6d5489c09b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:00 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-5f7ff27f-e019-43ff-8584-538d3efabd99 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Created volume successfully. Apr 21 21:00:01 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3ead59fa-a6d4-4f1f-92b9-dcd762131a2a 1073741824" returned: 0 in 0.506s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3ead59fa-a6d4-4f1f-92b9-dcd762131a2a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:01 devstack sudo[89735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3ead59fa-a6d4-4f1f-92b9-dcd762131a2a Apr 21 21:00:01 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:01 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3ead59fa-a6d4-4f1f-92b9-dcd762131a2a" returned: 0 in 0.403s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632b202c-7979-4b57-a0c8-3bc81c388ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ead59fa-a6d4-4f1f-92b9-dcd762131a2a', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a8381f-183d-49cc-aa43-9851e07225f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:01 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Volume volume-3ead59fa-a6d4-4f1f-92b9-dcd762131a2a (3ead59fa-a6d4-4f1f-92b9-dcd762131a2a): created successfully Apr 21 21:00:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a8381f-183d-49cc-aa43-9851e07225f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Flow 'volume_create_manager' (4ae2e768-6576-434a-884f-67fd6d8ab685) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:01 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-5156f907-d58b-4516-8c93-72b4119f5585 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Created volume successfully. Apr 21 21:00:01 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-40cb4455-503c-443b-985a-f409fe4404c7 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "cinder-3ead59fa-a6d4-4f1f-92b9-dcd762131a2a-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:01 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-40cb4455-503c-443b-985a-f409fe4404c7 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-3ead59fa-a6d4-4f1f-92b9-dcd762131a2a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:01 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-40cb4455-503c-443b-985a-f409fe4404c7 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "cinder-quobyte-3ead59fa-a6d4-4f1f-92b9-dcd762131a2a" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:01 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-40cb4455-503c-443b-985a-f409fe4404c7 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-quobyte-3ead59fa-a6d4-4f1f-92b9-dcd762131a2a" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:01 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc735500-b923-4bde-be3e-0698b6de13ea]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-40cb4455-503c-443b-985a-f409fe4404c7 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3ead59fa-a6d4-4f1f-92b9-dcd762131a2a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:02 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3ead59fa-a6d4-4f1f-92b9-dcd762131a2a Apr 21 21:00:02 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:02 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-40cb4455-503c-443b-985a-f409fe4404c7 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3ead59fa-a6d4-4f1f-92b9-dcd762131a2a" returned: 0 in 0.460s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-40cb4455-503c-443b-985a-f409fe4404c7 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3ead59fa-a6d4-4f1f-92b9-dcd762131a2a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:02 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3ead59fa-a6d4-4f1f-92b9-dcd762131a2a Apr 21 21:00:02 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:02 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-40cb4455-503c-443b-985a-f409fe4404c7 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-3ead59fa-a6d4-4f1f-92b9-dcd762131a2a" returned: 0 in 0.405s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:02 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-40cb4455-503c-443b-985a-f409fe4404c7 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-quobyte-3ead59fa-a6d4-4f1f-92b9-dcd762131a2a" released by "delete_volume" :: held 0.885s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:02 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-40cb4455-503c-443b-985a-f409fe4404c7 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Created reservations ['2b453186-1aeb-4bba-bc81-a7de3f3ebb4b', '18a83e3c-67e2-47c7-a837-68247315ae21', '7fd4d44c-c19d-46d9-9d0d-5a3b66b613e7', '7d4a2a5d-37b9-4e1a-953e-6880539b899b'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-40cb4455-503c-443b-985a-f409fe4404c7 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-40cb4455-503c-443b-985a-f409fe4404c7 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:02 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-40cb4455-503c-443b-985a-f409fe4404c7 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:02 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-40cb4455-503c-443b-985a-f409fe4404c7 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-40cb4455-503c-443b-985a-f409fe4404c7 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-40cb4455-503c-443b-985a-f409fe4404c7 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:02 devstack sudo[89746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:00:02 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-98f49971-c566-4407-8b82-0ee3cb31a254 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "cinder-b4762cb6-7fea-4e2a-ba8c-312d47fdbea8-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-98f49971-c566-4407-8b82-0ee3cb31a254 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-b4762cb6-7fea-4e2a-ba8c-312d47fdbea8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-98f49971-c566-4407-8b82-0ee3cb31a254 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "cinder-quobyte-b4762cb6-7fea-4e2a-ba8c-312d47fdbea8" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-98f49971-c566-4407-8b82-0ee3cb31a254 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-quobyte-b4762cb6-7fea-4e2a-ba8c-312d47fdbea8" acquired by "delete_volume" :: waited 0.006s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:03 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[f331019d-03df-4213-b707-9e009e9a1ae0]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-98f49971-c566-4407-8b82-0ee3cb31a254 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b4762cb6-7fea-4e2a-ba8c-312d47fdbea8 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:03 devstack sudo[89748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b4762cb6-7fea-4e2a-ba8c-312d47fdbea8 Apr 21 21:00:03 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:03 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-40cb4455-503c-443b-985a-f409fe4404c7 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.408s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:03 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-40cb4455-503c-443b-985a-f409fe4404c7 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:03 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-40cb4455-503c-443b-985a-f409fe4404c7 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Deleted volume successfully. Apr 21 21:00:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-40cb4455-503c-443b-985a-f409fe4404c7 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-3ead59fa-a6d4-4f1f-92b9-dcd762131a2a-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:03 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-98f49971-c566-4407-8b82-0ee3cb31a254 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b4762cb6-7fea-4e2a-ba8c-312d47fdbea8" returned: 0 in 0.466s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-98f49971-c566-4407-8b82-0ee3cb31a254 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b4762cb6-7fea-4e2a-ba8c-312d47fdbea8 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:03 devstack sudo[89754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b4762cb6-7fea-4e2a-ba8c-312d47fdbea8 Apr 21 21:00:03 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:03 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-98f49971-c566-4407-8b82-0ee3cb31a254 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-b4762cb6-7fea-4e2a-ba8c-312d47fdbea8" returned: 0 in 0.379s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:03 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-98f49971-c566-4407-8b82-0ee3cb31a254 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-quobyte-b4762cb6-7fea-4e2a-ba8c-312d47fdbea8" released by "delete_volume" :: held 0.865s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:03 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-98f49971-c566-4407-8b82-0ee3cb31a254 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Created reservations ['253422ab-631e-4ea9-9070-5cbace73d996', '6606831b-12b7-41af-994e-94b4079b33a9', 'c707cf3d-7e6e-4552-be07-0e543da5f2c5', '54e164ad-c01c-4d57-bd1a-22ae441ccd01'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-98f49971-c566-4407-8b82-0ee3cb31a254 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-98f49971-c566-4407-8b82-0ee3cb31a254 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-98f49971-c566-4407-8b82-0ee3cb31a254 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-98f49971-c566-4407-8b82-0ee3cb31a254 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-98f49971-c566-4407-8b82-0ee3cb31a254 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-98f49971-c566-4407-8b82-0ee3cb31a254 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:04 devstack sudo[89757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:00:04 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3316286e-3ab7-4609-8997-a5fa3cb71667 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "cinder-bfd6d8e1-6578-4366-b77b-f458d769e310-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3316286e-3ab7-4609-8997-a5fa3cb71667 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-bfd6d8e1-6578-4366-b77b-f458d769e310-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3316286e-3ab7-4609-8997-a5fa3cb71667 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "cinder-quobyte-bfd6d8e1-6578-4366-b77b-f458d769e310" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3316286e-3ab7-4609-8997-a5fa3cb71667 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-quobyte-bfd6d8e1-6578-4366-b77b-f458d769e310" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:04 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[850033fb-7aa3-4386-a85e-5532edd859d3]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3316286e-3ab7-4609-8997-a5fa3cb71667 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bfd6d8e1-6578-4366-b77b-f458d769e310 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:04 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bfd6d8e1-6578-4366-b77b-f458d769e310 Apr 21 21:00:04 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:04 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-98f49971-c566-4407-8b82-0ee3cb31a254 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.426s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:04 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-98f49971-c566-4407-8b82-0ee3cb31a254 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:04 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-98f49971-c566-4407-8b82-0ee3cb31a254 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Deleted volume successfully. Apr 21 21:00:04 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-98f49971-c566-4407-8b82-0ee3cb31a254 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-b4762cb6-7fea-4e2a-ba8c-312d47fdbea8-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:04 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3316286e-3ab7-4609-8997-a5fa3cb71667 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bfd6d8e1-6578-4366-b77b-f458d769e310" returned: 0 in 0.450s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3316286e-3ab7-4609-8997-a5fa3cb71667 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bfd6d8e1-6578-4366-b77b-f458d769e310 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:04 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bfd6d8e1-6578-4366-b77b-f458d769e310 Apr 21 21:00:04 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:05 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3316286e-3ab7-4609-8997-a5fa3cb71667 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-bfd6d8e1-6578-4366-b77b-f458d769e310" returned: 0 in 0.393s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:05 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3316286e-3ab7-4609-8997-a5fa3cb71667 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-quobyte-bfd6d8e1-6578-4366-b77b-f458d769e310" released by "delete_volume" :: held 0.863s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:05 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-3316286e-3ab7-4609-8997-a5fa3cb71667 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Created reservations ['07cdabe9-14c4-4de2-a833-1e345ce1f3dc', '83f5212e-7267-402e-8fd7-2b5d22d449f5', '12496cf7-4f45-431b-94bb-c2fdb89413c1', '9f978e61-20a5-4e6a-89e6-32ef5880043a'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3316286e-3ab7-4609-8997-a5fa3cb71667 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3316286e-3ab7-4609-8997-a5fa3cb71667 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:05 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3316286e-3ab7-4609-8997-a5fa3cb71667 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:05 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3316286e-3ab7-4609-8997-a5fa3cb71667 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3316286e-3ab7-4609-8997-a5fa3cb71667 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3316286e-3ab7-4609-8997-a5fa3cb71667 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:05 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:00:05 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:05 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c215f859-0b3f-44e5-8299-9420932cfe22 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "cinder-0b63b445-d44a-4496-9590-2784be444f52-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:05 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c215f859-0b3f-44e5-8299-9420932cfe22 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-0b63b445-d44a-4496-9590-2784be444f52-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:05 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c215f859-0b3f-44e5-8299-9420932cfe22 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "cinder-quobyte-0b63b445-d44a-4496-9590-2784be444f52" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:05 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c215f859-0b3f-44e5-8299-9420932cfe22 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-quobyte-0b63b445-d44a-4496-9590-2784be444f52" acquired by "delete_volume" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:05 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf99df9-ec7c-4a3f-809d-77a685b38493]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c215f859-0b3f-44e5-8299-9420932cfe22 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b63b445-d44a-4496-9590-2784be444f52 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:05 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b63b445-d44a-4496-9590-2784be444f52 Apr 21 21:00:05 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:05 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3316286e-3ab7-4609-8997-a5fa3cb71667 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.428s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:05 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-3316286e-3ab7-4609-8997-a5fa3cb71667 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:05 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-3316286e-3ab7-4609-8997-a5fa3cb71667 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Deleted volume successfully. Apr 21 21:00:05 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3316286e-3ab7-4609-8997-a5fa3cb71667 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-bfd6d8e1-6578-4366-b77b-f458d769e310-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:05 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c215f859-0b3f-44e5-8299-9420932cfe22 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b63b445-d44a-4496-9590-2784be444f52" returned: 0 in 0.452s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c215f859-0b3f-44e5-8299-9420932cfe22 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b63b445-d44a-4496-9590-2784be444f52 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:05 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b63b445-d44a-4496-9590-2784be444f52 Apr 21 21:00:05 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:06 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c215f859-0b3f-44e5-8299-9420932cfe22 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0b63b445-d44a-4496-9590-2784be444f52" returned: 0 in 0.386s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:06 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c215f859-0b3f-44e5-8299-9420932cfe22 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-quobyte-0b63b445-d44a-4496-9590-2784be444f52" released by "delete_volume" :: held 0.856s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:06 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-c215f859-0b3f-44e5-8299-9420932cfe22 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Created reservations ['67e416c2-108e-4b60-a378-dd31fe8b8374', '0de12415-1093-4148-88d3-da7c3e4d05b9', '98c4088a-503b-4b85-acf6-b3164b5131a8', '46b65cf0-4515-4d40-ab14-1b6e86e76ace'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c215f859-0b3f-44e5-8299-9420932cfe22 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c215f859-0b3f-44e5-8299-9420932cfe22 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c215f859-0b3f-44e5-8299-9420932cfe22 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c215f859-0b3f-44e5-8299-9420932cfe22 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c215f859-0b3f-44e5-8299-9420932cfe22 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c215f859-0b3f-44e5-8299-9420932cfe22 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:06 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:00:06 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:06 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-69c93e15-d863-49d7-ae2e-be80f826c49e tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "cinder-9dd41af8-c561-4d6b-953b-881339bb5640-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:06 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-69c93e15-d863-49d7-ae2e-be80f826c49e tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-9dd41af8-c561-4d6b-953b-881339bb5640-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:06 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-69c93e15-d863-49d7-ae2e-be80f826c49e tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "cinder-quobyte-9dd41af8-c561-4d6b-953b-881339bb5640" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:06 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-69c93e15-d863-49d7-ae2e-be80f826c49e tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-quobyte-9dd41af8-c561-4d6b-953b-881339bb5640" acquired by "delete_volume" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:06 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[f887f16c-eaaa-440d-babd-9bdccdf548aa]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-69c93e15-d863-49d7-ae2e-be80f826c49e tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd41af8-c561-4d6b-953b-881339bb5640 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:06 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd41af8-c561-4d6b-953b-881339bb5640 Apr 21 21:00:06 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:06 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c215f859-0b3f-44e5-8299-9420932cfe22 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.421s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:06 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-c215f859-0b3f-44e5-8299-9420932cfe22 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:06 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-c215f859-0b3f-44e5-8299-9420932cfe22 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Deleted volume successfully. Apr 21 21:00:06 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c215f859-0b3f-44e5-8299-9420932cfe22 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-0b63b445-d44a-4496-9590-2784be444f52-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:06 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-69c93e15-d863-49d7-ae2e-be80f826c49e tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd41af8-c561-4d6b-953b-881339bb5640" returned: 0 in 0.480s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-69c93e15-d863-49d7-ae2e-be80f826c49e tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd41af8-c561-4d6b-953b-881339bb5640 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:06 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd41af8-c561-4d6b-953b-881339bb5640 Apr 21 21:00:06 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:07 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-69c93e15-d863-49d7-ae2e-be80f826c49e tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd41af8-c561-4d6b-953b-881339bb5640" returned: 0 in 0.413s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:07 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-69c93e15-d863-49d7-ae2e-be80f826c49e tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-quobyte-9dd41af8-c561-4d6b-953b-881339bb5640" released by "delete_volume" :: held 0.910s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:07 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-69c93e15-d863-49d7-ae2e-be80f826c49e tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Created reservations ['dc781198-b9d5-438b-99cd-e3d478e46b5f', '25817895-e5b7-4505-8ecd-3121d1b1c407', '1a7cf4d6-b9bd-412c-9814-7a6d34b9766f', '4b8bd294-856e-4caf-808b-127aea57e5e2'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-69c93e15-d863-49d7-ae2e-be80f826c49e tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-69c93e15-d863-49d7-ae2e-be80f826c49e tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:07 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-69c93e15-d863-49d7-ae2e-be80f826c49e tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:07 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-69c93e15-d863-49d7-ae2e-be80f826c49e tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-69c93e15-d863-49d7-ae2e-be80f826c49e tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-69c93e15-d863-49d7-ae2e-be80f826c49e tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:07 devstack sudo[89790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:00:07 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:07 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7a6a85ca-3188-4cbb-a68d-5aa4a58261c5 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "cinder-f7deb57d-3c47-4957-8d0f-e76c47aee9bb-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:07 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7a6a85ca-3188-4cbb-a68d-5aa4a58261c5 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-f7deb57d-3c47-4957-8d0f-e76c47aee9bb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:07 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7a6a85ca-3188-4cbb-a68d-5aa4a58261c5 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "cinder-quobyte-f7deb57d-3c47-4957-8d0f-e76c47aee9bb" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:07 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7a6a85ca-3188-4cbb-a68d-5aa4a58261c5 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-quobyte-f7deb57d-3c47-4957-8d0f-e76c47aee9bb" acquired by "delete_volume" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:07 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0efc506-067d-40d8-b2ac-abe468535266]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7a6a85ca-3188-4cbb-a68d-5aa4a58261c5 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f7deb57d-3c47-4957-8d0f-e76c47aee9bb {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:07 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f7deb57d-3c47-4957-8d0f-e76c47aee9bb Apr 21 21:00:07 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:07 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-69c93e15-d863-49d7-ae2e-be80f826c49e tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.436s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:07 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-69c93e15-d863-49d7-ae2e-be80f826c49e tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:07 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-69c93e15-d863-49d7-ae2e-be80f826c49e tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Deleted volume successfully. Apr 21 21:00:07 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-69c93e15-d863-49d7-ae2e-be80f826c49e tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-9dd41af8-c561-4d6b-953b-881339bb5640-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:07 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7a6a85ca-3188-4cbb-a68d-5aa4a58261c5 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f7deb57d-3c47-4957-8d0f-e76c47aee9bb" returned: 0 in 0.448s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7a6a85ca-3188-4cbb-a68d-5aa4a58261c5 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f7deb57d-3c47-4957-8d0f-e76c47aee9bb {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:07 devstack sudo[89798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f7deb57d-3c47-4957-8d0f-e76c47aee9bb Apr 21 21:00:07 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:08 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7a6a85ca-3188-4cbb-a68d-5aa4a58261c5 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f7deb57d-3c47-4957-8d0f-e76c47aee9bb" returned: 0 in 0.382s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:08 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7a6a85ca-3188-4cbb-a68d-5aa4a58261c5 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-quobyte-f7deb57d-3c47-4957-8d0f-e76c47aee9bb" released by "delete_volume" :: held 0.853s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:08 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-7a6a85ca-3188-4cbb-a68d-5aa4a58261c5 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Created reservations ['f88e4e1d-db10-47c8-9dde-1f1662de7e9a', 'bcdb3696-085b-4090-9fdb-b118641c453b', '6ca47b2a-22dc-4689-ad9b-10a868d848f5', 'd4ff6944-18cf-450f-8427-b10835327542'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7a6a85ca-3188-4cbb-a68d-5aa4a58261c5 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7a6a85ca-3188-4cbb-a68d-5aa4a58261c5 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:08 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7a6a85ca-3188-4cbb-a68d-5aa4a58261c5 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:08 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7a6a85ca-3188-4cbb-a68d-5aa4a58261c5 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7a6a85ca-3188-4cbb-a68d-5aa4a58261c5 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7a6a85ca-3188-4cbb-a68d-5aa4a58261c5 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:08 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:00:08 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:08 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7a6a85ca-3188-4cbb-a68d-5aa4a58261c5 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.428s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:08 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-7a6a85ca-3188-4cbb-a68d-5aa4a58261c5 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:08 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-7a6a85ca-3188-4cbb-a68d-5aa4a58261c5 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Deleted volume successfully. Apr 21 21:00:08 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7a6a85ca-3188-4cbb-a68d-5aa4a58261c5 tempest-CreateVolumesFromSourceVolumeTest-186623023 None] Lock "cinder-f7deb57d-3c47-4957-8d0f-e76c47aee9bb-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Flow 'volume_create_manager' (23949616-90b3-45f3-b9ef-fdafc4a01399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b40da6-f55f-4667-945a-bdad75730f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b40da6-f55f-4667-945a-bdad75730f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa17313-c916-49ba-829f-e121658513f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0cf5771147248b498b4ee4a5812daf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:10Z,use_quota=True,user_id='ac3dbd7743a444fdb8eb77d1cd303ede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad146bde-3d65-4a7f-8cda-e762f6c1d702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad146bde-3d65-4a7f-8cda-e762f6c1d702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59cca6fc-1059-4703-9c39-54d45d9a765b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59cca6fc-1059-4703-9c39-54d45d9a765b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aa17313-c916-49ba-829f-e121658513f2', 'volume_name': 'volume-8aa17313-c916-49ba-829f-e121658513f2', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd9949d-f13a-44da-8d8d-5af63c6a1fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd9949d-f13a-44da-8d8d-5af63c6a1fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30de1f57-7628-4fca-8d69-7446b7b3ec3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:10 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Volume 8aa17313-c916-49ba-829f-e121658513f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aa17313-c916-49ba-829f-e121658513f2', 'volume_size': 1} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa17313-c916-49ba-829f-e121658513f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0cf5771147248b498b4ee4a5812daf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:10Z,use_quota=True,user_id='ac3dbd7743a444fdb8eb77d1cd303ede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Creating volume 8aa17313-c916-49ba-829f-e121658513f2 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:10 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8aa17313-c916-49ba-829f-e121658513f2 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:10 devstack sudo[89805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8aa17313-c916-49ba-829f-e121658513f2 1073741824 Apr 21 21:00:10 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:10 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8aa17313-c916-49ba-829f-e121658513f2 1073741824" returned: 0 in 0.453s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8aa17313-c916-49ba-829f-e121658513f2 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:10 devstack sudo[89810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8aa17313-c916-49ba-829f-e121658513f2 Apr 21 21:00:10 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:10 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8aa17313-c916-49ba-829f-e121658513f2" returned: 0 in 0.388s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30de1f57-7628-4fca-8d69-7446b7b3ec3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aa17313-c916-49ba-829f-e121658513f2', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bdc0bff-1bd3-4d92-b1b4-0fd0b797c0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:10 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Volume volume-8aa17313-c916-49ba-829f-e121658513f2 (8aa17313-c916-49ba-829f-e121658513f2): created successfully Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bdc0bff-1bd3-4d92-b1b4-0fd0b797c0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:10 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Flow 'volume_create_manager' (23949616-90b3-45f3-b9ef-fdafc4a01399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:10 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-7832270d-e62b-4a12-82c9-d814bd2e067a tempest-CinderUnicodeTest-1766879219 None] Created volume successfully. Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Flow 'volume_create_manager' (c7e49c2d-3fb0-4d04-8b2c-16f7a4a97eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f90c72-ef9d-4463-8b30-ccbf205b71ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f90c72-ef9d-4463-8b30-ccbf205b71ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1658289533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a27112c-b4b7-4f59-8920-437628f5fb2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0cf5771147248b498b4ee4a5812daf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:11Z,use_quota=True,user_id='ac3dbd7743a444fdb8eb77d1cd303ede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db59d57d-dedf-441a-8b15-04c79cf89c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db59d57d-dedf-441a-8b15-04c79cf89c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680ec47e-2cd9-4d26-8653-7c62fb94e43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680ec47e-2cd9-4d26-8653-7c62fb94e43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a27112c-b4b7-4f59-8920-437628f5fb2f', 'volume_name': 'volume-9a27112c-b4b7-4f59-8920-437628f5fb2f', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04fa4776-c9b4-4ee3-ae65-636d9f69a918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04fa4776-c9b4-4ee3-ae65-636d9f69a918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9387ae-92bc-49e1-806e-0f9a59019cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:11 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Volume 9a27112c-b4b7-4f59-8920-437628f5fb2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a27112c-b4b7-4f59-8920-437628f5fb2f', 'volume_size': 1} Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1658289533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a27112c-b4b7-4f59-8920-437628f5fb2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0cf5771147248b498b4ee4a5812daf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:11Z,use_quota=True,user_id='ac3dbd7743a444fdb8eb77d1cd303ede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Creating volume 9a27112c-b4b7-4f59-8920-437628f5fb2f {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:11 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:11 devstack sudo[89813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f 1073741824 Apr 21 21:00:11 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:11 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f 1073741824" returned: 0 in 0.448s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:11 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f Apr 21 21:00:11 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:12 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f" returned: 0 in 0.420s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:12 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9387ae-92bc-49e1-806e-0f9a59019cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a27112c-b4b7-4f59-8920-437628f5fb2f', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b2e272d-5182-4794-b006-d4a1b6ed1f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:12 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Volume volume-9a27112c-b4b7-4f59-8920-437628f5fb2f (9a27112c-b4b7-4f59-8920-437628f5fb2f): created successfully Apr 21 21:00:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b2e272d-5182-4794-b006-d4a1b6ed1f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Flow 'volume_create_manager' (c7e49c2d-3fb0-4d04-8b2c-16f7a4a97eab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:12 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-69f405ba-f3fd-443b-9706-43a0259587d6 tempest-CinderUnicodeTest-1766879219 None] Created volume successfully. Apr 21 21:00:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-79d4982c-702a-4e1e-94f8-500492a073db tempest-CinderUnicodeTest-1766879219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-79d4982c-702a-4e1e-94f8-500492a073db tempest-CinderUnicodeTest-1766879219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:12 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-79d4982c-702a-4e1e-94f8-500492a073db tempest-CinderUnicodeTest-1766879219 None] Creating offline snapshot 164b4dab-2116-4ada-80e1-c5521afe7fef of volume 9a27112c-b4b7-4f59-8920-437628f5fb2f {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:00:12 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9b65db-76fe-4c33-b902-651d7907165a]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-79d4982c-702a-4e1e-94f8-500492a073db tempest-CinderUnicodeTest-1766879219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:12 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f Apr 21 21:00:12 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:13 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-79d4982c-702a-4e1e-94f8-500492a073db tempest-CinderUnicodeTest-1766879219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f" returned: 0 in 0.450s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-79d4982c-702a-4e1e-94f8-500492a073db tempest-CinderUnicodeTest-1766879219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.164b4dab-2116-4ada-80e1-c5521afe7fef 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:13 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.164b4dab-2116-4ada-80e1-c5521afe7fef 1G Apr 21 21:00:13 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:13 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-79d4982c-702a-4e1e-94f8-500492a073db tempest-CinderUnicodeTest-1766879219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.164b4dab-2116-4ada-80e1-c5521afe7fef 1G" returned: 0 in 0.439s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-79d4982c-702a-4e1e-94f8-500492a073db tempest-CinderUnicodeTest-1766879219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a27112c-b4b7-4f59-8920-437628f5fb2f -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.164b4dab-2116-4ada-80e1-c5521afe7fef {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:13 devstack sudo[89831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a27112c-b4b7-4f59-8920-437628f5fb2f -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.164b4dab-2116-4ada-80e1-c5521afe7fef Apr 21 21:00:13 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:13 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-79d4982c-702a-4e1e-94f8-500492a073db tempest-CinderUnicodeTest-1766879219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a27112c-b4b7-4f59-8920-437628f5fb2f -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.164b4dab-2116-4ada-80e1-c5521afe7fef" returned: 0 in 0.410s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:13 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-79d4982c-702a-4e1e-94f8-500492a073db tempest-CinderUnicodeTest-1766879219 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.164b4dab-2116-4ada-80e1-c5521afe7fef is being set with open permissions: ugo+rw Apr 21 21:00:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-79d4982c-702a-4e1e-94f8-500492a073db tempest-CinderUnicodeTest-1766879219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.164b4dab-2116-4ada-80e1-c5521afe7fef {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:13 devstack sudo[89836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.164b4dab-2116-4ada-80e1-c5521afe7fef Apr 21 21:00:13 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:14 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-79d4982c-702a-4e1e-94f8-500492a073db tempest-CinderUnicodeTest-1766879219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.164b4dab-2116-4ada-80e1-c5521afe7fef" returned: 0 in 0.381s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-79d4982c-702a-4e1e-94f8-500492a073db tempest-CinderUnicodeTest-1766879219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:14 devstack sudo[89839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.info Apr 21 21:00:14 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:14 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-79d4982c-702a-4e1e-94f8-500492a073db tempest-CinderUnicodeTest-1766879219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.info" returned: 0 in 0.386s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:14 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-79d4982c-702a-4e1e-94f8-500492a073db tempest-CinderUnicodeTest-1766879219 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.info is being set with open permissions: ugo+rw Apr 21 21:00:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-79d4982c-702a-4e1e-94f8-500492a073db tempest-CinderUnicodeTest-1766879219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:14 devstack sudo[89842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.info Apr 21 21:00:14 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:15 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-79d4982c-702a-4e1e-94f8-500492a073db tempest-CinderUnicodeTest-1766879219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.info" returned: 0 in 0.373s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-79d4982c-702a-4e1e-94f8-500492a073db tempest-CinderUnicodeTest-1766879219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.490s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:15 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-79d4982c-702a-4e1e-94f8-500492a073db tempest-CinderUnicodeTest-1766879219 None] Create snapshot completed successfully Apr 21 21:00:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c604679d-3821-4883-9c95-34a82bdeed80 tempest-CinderUnicodeTest-1766879219 None] Acquiring lock "cinder-164b4dab-2116-4ada-80e1-c5521afe7fef-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c604679d-3821-4883-9c95-34a82bdeed80 tempest-CinderUnicodeTest-1766879219 None] Lock "cinder-164b4dab-2116-4ada-80e1-c5521afe7fef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c604679d-3821-4883-9c95-34a82bdeed80 tempest-CinderUnicodeTest-1766879219 None] Acquiring lock "cinder-quobyte-9a27112c-b4b7-4f59-8920-437628f5fb2f" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c604679d-3821-4883-9c95-34a82bdeed80 tempest-CinderUnicodeTest-1766879219 None] Lock "cinder-quobyte-9a27112c-b4b7-4f59-8920-437628f5fb2f" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c604679d-3821-4883-9c95-34a82bdeed80 tempest-CinderUnicodeTest-1766879219 None] Acquiring lock "cinder-quobyte-164b4dab-2116-4ada-80e1-c5521afe7fef" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c604679d-3821-4883-9c95-34a82bdeed80 tempest-CinderUnicodeTest-1766879219 None] Lock "cinder-quobyte-164b4dab-2116-4ada-80e1-c5521afe7fef" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-c604679d-3821-4883-9c95-34a82bdeed80 tempest-CinderUnicodeTest-1766879219 None] Deleting offline snapshot 164b4dab-2116-4ada-80e1-c5521afe7fef of volume 9a27112c-b4b7-4f59-8920-437628f5fb2f {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:00:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-c604679d-3821-4883-9c95-34a82bdeed80 tempest-CinderUnicodeTest-1766879219 None] snapshot_file for this snap is: volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.164b4dab-2116-4ada-80e1-c5521afe7fef {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:00:15 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dd28c3-ace9-40da-b2b0-3604e512e2dd]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c604679d-3821-4883-9c95-34a82bdeed80 tempest-CinderUnicodeTest-1766879219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.164b4dab-2116-4ada-80e1-c5521afe7fef {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:15 devstack sudo[89845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.164b4dab-2116-4ada-80e1-c5521afe7fef Apr 21 21:00:15 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:16 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c604679d-3821-4883-9c95-34a82bdeed80 tempest-CinderUnicodeTest-1766879219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.164b4dab-2116-4ada-80e1-c5521afe7fef" returned: 0 in 0.443s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:16 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-c604679d-3821-4883-9c95-34a82bdeed80 tempest-CinderUnicodeTest-1766879219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a27112c-b4b7-4f59-8920-437628f5fb2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:00:16 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c19606-4322-437e-aeeb-34aa51126367]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c604679d-3821-4883-9c95-34a82bdeed80 tempest-CinderUnicodeTest-1766879219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:16 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f Apr 21 21:00:16 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:16 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c604679d-3821-4883-9c95-34a82bdeed80 tempest-CinderUnicodeTest-1766879219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f" returned: 0 in 0.441s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c604679d-3821-4883-9c95-34a82bdeed80 tempest-CinderUnicodeTest-1766879219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.164b4dab-2116-4ada-80e1-c5521afe7fef {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:16 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.164b4dab-2116-4ada-80e1-c5521afe7fef Apr 21 21:00:16 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:17 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c604679d-3821-4883-9c95-34a82bdeed80 tempest-CinderUnicodeTest-1766879219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.164b4dab-2116-4ada-80e1-c5521afe7fef" returned: 0 in 0.414s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c604679d-3821-4883-9c95-34a82bdeed80 tempest-CinderUnicodeTest-1766879219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.164b4dab-2116-4ada-80e1-c5521afe7fef {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:17 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.164b4dab-2116-4ada-80e1-c5521afe7fef Apr 21 21:00:17 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:17 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c604679d-3821-4883-9c95-34a82bdeed80 tempest-CinderUnicodeTest-1766879219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f.164b4dab-2116-4ada-80e1-c5521afe7fef" returned: 0 in 0.382s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:17 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c604679d-3821-4883-9c95-34a82bdeed80 tempest-CinderUnicodeTest-1766879219 None] Lock "cinder-quobyte-164b4dab-2116-4ada-80e1-c5521afe7fef" released by "_delete_snapshot" :: held 1.731s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:17 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c604679d-3821-4883-9c95-34a82bdeed80 tempest-CinderUnicodeTest-1766879219 None] Lock "cinder-quobyte-9a27112c-b4b7-4f59-8920-437628f5fb2f" released by "delete_snapshot" :: held 1.742s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:17 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-c604679d-3821-4883-9c95-34a82bdeed80 tempest-CinderUnicodeTest-1766879219 None] Created reservations ['b654c538-e2b1-424c-9e6a-13cccba49324', 'a2a6366d-4a6e-4216-9557-ca829e6dc3de', '7ae0f7a5-7b89-41e8-8ac5-14e3f2c3f61b', 'df7eebd2-dfd5-4485-a4d4-1d41cb2f2f6d'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:17 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-c604679d-3821-4883-9c95-34a82bdeed80 tempest-CinderUnicodeTest-1766879219 None] Delete snapshot completed successfully. Apr 21 21:00:17 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c604679d-3821-4883-9c95-34a82bdeed80 tempest-CinderUnicodeTest-1766879219 None] Lock "cinder-164b4dab-2116-4ada-80e1-c5521afe7fef-delete_snapshot" released by "delete_snapshot" :: held 1.814s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:17 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-50bdb614-97b5-4c55-a5a2-e9169001221e tempest-CinderUnicodeTest-1766879219 None] Acquiring lock "cinder-9a27112c-b4b7-4f59-8920-437628f5fb2f-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:17 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-50bdb614-97b5-4c55-a5a2-e9169001221e tempest-CinderUnicodeTest-1766879219 None] Lock "cinder-9a27112c-b4b7-4f59-8920-437628f5fb2f-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:17 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-50bdb614-97b5-4c55-a5a2-e9169001221e tempest-CinderUnicodeTest-1766879219 None] Acquiring lock "cinder-quobyte-9a27112c-b4b7-4f59-8920-437628f5fb2f" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:17 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-50bdb614-97b5-4c55-a5a2-e9169001221e tempest-CinderUnicodeTest-1766879219 None] Lock "cinder-quobyte-9a27112c-b4b7-4f59-8920-437628f5fb2f" acquired by "delete_volume" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:17 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6863b53-88d3-4930-b38f-f03caa074add]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-50bdb614-97b5-4c55-a5a2-e9169001221e tempest-CinderUnicodeTest-1766879219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:17 devstack sudo[89863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f Apr 21 21:00:17 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:18 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-50bdb614-97b5-4c55-a5a2-e9169001221e tempest-CinderUnicodeTest-1766879219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f" returned: 0 in 0.447s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-50bdb614-97b5-4c55-a5a2-e9169001221e tempest-CinderUnicodeTest-1766879219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:18 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f Apr 21 21:00:18 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:18 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-50bdb614-97b5-4c55-a5a2-e9169001221e tempest-CinderUnicodeTest-1766879219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9a27112c-b4b7-4f59-8920-437628f5fb2f" returned: 0 in 0.416s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:18 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-50bdb614-97b5-4c55-a5a2-e9169001221e tempest-CinderUnicodeTest-1766879219 None] Lock "cinder-quobyte-9a27112c-b4b7-4f59-8920-437628f5fb2f" released by "delete_volume" :: held 0.898s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:18 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-50bdb614-97b5-4c55-a5a2-e9169001221e tempest-CinderUnicodeTest-1766879219 None] Created reservations ['1c9cb8a6-46e5-465b-aedd-e889dcae3e5a', '2fb4a07d-a5c0-4dec-8525-a39b3f4b6b7e', '402805f7-878f-4068-ac0f-014536351f4c', '97f9b90b-ecdd-4973-a399-a8c20047a6c3'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-50bdb614-97b5-4c55-a5a2-e9169001221e tempest-CinderUnicodeTest-1766879219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-50bdb614-97b5-4c55-a5a2-e9169001221e tempest-CinderUnicodeTest-1766879219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-50bdb614-97b5-4c55-a5a2-e9169001221e tempest-CinderUnicodeTest-1766879219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-50bdb614-97b5-4c55-a5a2-e9169001221e tempest-CinderUnicodeTest-1766879219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-50bdb614-97b5-4c55-a5a2-e9169001221e tempest-CinderUnicodeTest-1766879219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-50bdb614-97b5-4c55-a5a2-e9169001221e tempest-CinderUnicodeTest-1766879219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:18 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:00:18 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:18 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5f31d2b8-90c4-43d0-a948-074b258cee43 tempest-CinderUnicodeTest-1766879219 None] Acquiring lock "cinder-8aa17313-c916-49ba-829f-e121658513f2-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:18 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5f31d2b8-90c4-43d0-a948-074b258cee43 tempest-CinderUnicodeTest-1766879219 None] Lock "cinder-8aa17313-c916-49ba-829f-e121658513f2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:18 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5f31d2b8-90c4-43d0-a948-074b258cee43 tempest-CinderUnicodeTest-1766879219 None] Acquiring lock "cinder-quobyte-8aa17313-c916-49ba-829f-e121658513f2" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:18 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5f31d2b8-90c4-43d0-a948-074b258cee43 tempest-CinderUnicodeTest-1766879219 None] Lock "cinder-quobyte-8aa17313-c916-49ba-829f-e121658513f2" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:18 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[90685e3e-f2f3-473a-a896-e6ade6a7243e]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5f31d2b8-90c4-43d0-a948-074b258cee43 tempest-CinderUnicodeTest-1766879219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8aa17313-c916-49ba-829f-e121658513f2 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:19 devstack sudo[89874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8aa17313-c916-49ba-829f-e121658513f2 Apr 21 21:00:19 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:19 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-50bdb614-97b5-4c55-a5a2-e9169001221e tempest-CinderUnicodeTest-1766879219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.460s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:19 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-50bdb614-97b5-4c55-a5a2-e9169001221e tempest-CinderUnicodeTest-1766879219 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:19 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-50bdb614-97b5-4c55-a5a2-e9169001221e tempest-CinderUnicodeTest-1766879219 None] Deleted volume successfully. Apr 21 21:00:19 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-50bdb614-97b5-4c55-a5a2-e9169001221e tempest-CinderUnicodeTest-1766879219 None] Lock "cinder-9a27112c-b4b7-4f59-8920-437628f5fb2f-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:19 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5f31d2b8-90c4-43d0-a948-074b258cee43 tempest-CinderUnicodeTest-1766879219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8aa17313-c916-49ba-829f-e121658513f2" returned: 0 in 0.487s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5f31d2b8-90c4-43d0-a948-074b258cee43 tempest-CinderUnicodeTest-1766879219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8aa17313-c916-49ba-829f-e121658513f2 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:19 devstack sudo[89880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8aa17313-c916-49ba-829f-e121658513f2 Apr 21 21:00:19 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:19 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5f31d2b8-90c4-43d0-a948-074b258cee43 tempest-CinderUnicodeTest-1766879219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8aa17313-c916-49ba-829f-e121658513f2" returned: 0 in 0.386s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:19 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5f31d2b8-90c4-43d0-a948-074b258cee43 tempest-CinderUnicodeTest-1766879219 None] Lock "cinder-quobyte-8aa17313-c916-49ba-829f-e121658513f2" released by "delete_volume" :: held 0.895s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:19 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-5f31d2b8-90c4-43d0-a948-074b258cee43 tempest-CinderUnicodeTest-1766879219 None] Created reservations ['56971590-243f-4899-96b6-b35cb6b9622d', '484169f7-5631-4064-9dd9-54dce3f72964', '2d6929a4-ba84-4dce-848b-62df3c81c83d', '62224027-b944-476a-a1e2-4f2c8882f25c'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5f31d2b8-90c4-43d0-a948-074b258cee43 tempest-CinderUnicodeTest-1766879219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5f31d2b8-90c4-43d0-a948-074b258cee43 tempest-CinderUnicodeTest-1766879219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5f31d2b8-90c4-43d0-a948-074b258cee43 tempest-CinderUnicodeTest-1766879219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5f31d2b8-90c4-43d0-a948-074b258cee43 tempest-CinderUnicodeTest-1766879219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5f31d2b8-90c4-43d0-a948-074b258cee43 tempest-CinderUnicodeTest-1766879219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5f31d2b8-90c4-43d0-a948-074b258cee43 tempest-CinderUnicodeTest-1766879219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:19 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:00:19 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:20 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5f31d2b8-90c4-43d0-a948-074b258cee43 tempest-CinderUnicodeTest-1766879219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.466s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:20 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-5f31d2b8-90c4-43d0-a948-074b258cee43 tempest-CinderUnicodeTest-1766879219 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:20 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-5f31d2b8-90c4-43d0-a948-074b258cee43 tempest-CinderUnicodeTest-1766879219 None] Deleted volume successfully. Apr 21 21:00:20 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5f31d2b8-90c4-43d0-a948-074b258cee43 tempest-CinderUnicodeTest-1766879219 None] Lock "cinder-8aa17313-c916-49ba-829f-e121658513f2-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:29 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:UPDATE=98,cinder:SELECT=67,cinder:DELETE=11,cinder:INSERT=24 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:00:30 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:SELECT=62,cinder:INSERT=21,cinder:UPDATE=92,cinder:DELETE=6 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:00:34 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:34 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Flow 'volume_create_manager' (b1fd2095-e419-45f2-a986-d3703e6238fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:34 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60049af6-3a48-4c22-bc80-89d7bc834a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:34 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60049af6-3a48-4c22-bc80-89d7bc834a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1088556583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb07ce1-19b3-4f08-99b2-fd9bac3245f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a493796e2947c68e262949de05c7c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:35Z,use_quota=True,user_id='a3b5f05de4d5461e9154bafd25c3249f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:34 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1242e238-e8e1-44a5-94fb-423ed424aab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:34 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1242e238-e8e1-44a5-94fb-423ed424aab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:34 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8b76f0-8d1b-4cb1-b729-77f155752623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:34 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8b76f0-8d1b-4cb1-b729-77f155752623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eb07ce1-19b3-4f08-99b2-fd9bac3245f6', 'volume_name': 'volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:34 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3422f90-fa8c-4a3e-9791-fdb4b93f3192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:34 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3422f90-fa8c-4a3e-9791-fdb4b93f3192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:34 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78a03c0-8b46-402e-a053-11816332d45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:34 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Volume 9eb07ce1-19b3-4f08-99b2-fd9bac3245f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6', 'volume_size': 1} Apr 21 21:00:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:34 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1088556583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb07ce1-19b3-4f08-99b2-fd9bac3245f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a493796e2947c68e262949de05c7c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:35Z,use_quota=True,user_id='a3b5f05de4d5461e9154bafd25c3249f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:34 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Creating volume 9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:34 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:34 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:34 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:34 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:00:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:34 devstack sudo[89890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 1073741824 Apr 21 21:00:34 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:35 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 1073741824" returned: 0 in 0.456s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:35 devstack sudo[89895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 Apr 21 21:00:35 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:35 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6" returned: 0 in 0.396s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:35 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78a03c0-8b46-402e-a053-11816332d45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120c7255-8fd5-478d-8a9e-62b4a3e962dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:35 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Volume volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 (9eb07ce1-19b3-4f08-99b2-fd9bac3245f6): created successfully Apr 21 21:00:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120c7255-8fd5-478d-8a9e-62b4a3e962dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Flow 'volume_create_manager' (b1fd2095-e419-45f2-a986-d3703e6238fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:35 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-4f26ba1a-4d65-4169-b55c-c463403a049f tempest-SnapshotDependencyTests-1561085721 None] Created volume successfully. Apr 21 21:00:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9af44191-0206-4736-853e-e0efb18e247f tempest-SnapshotDependencyTests-1561085721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9af44191-0206-4736-853e-e0efb18e247f tempest-SnapshotDependencyTests-1561085721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:35 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-9af44191-0206-4736-853e-e0efb18e247f tempest-SnapshotDependencyTests-1561085721 None] Creating offline snapshot 20559c2a-0f02-4169-b76a-17886e64bdc7 of volume 9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:00:35 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa58bfea-be1e-4f6b-ae20-a02d729da2e9]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9af44191-0206-4736-853e-e0efb18e247f tempest-SnapshotDependencyTests-1561085721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:35 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 Apr 21 21:00:35 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:36 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9af44191-0206-4736-853e-e0efb18e247f tempest-SnapshotDependencyTests-1561085721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6" returned: 0 in 0.445s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9af44191-0206-4736-853e-e0efb18e247f tempest-SnapshotDependencyTests-1561085721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.20559c2a-0f02-4169-b76a-17886e64bdc7 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:36 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.20559c2a-0f02-4169-b76a-17886e64bdc7 1G Apr 21 21:00:36 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:36 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9af44191-0206-4736-853e-e0efb18e247f tempest-SnapshotDependencyTests-1561085721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.20559c2a-0f02-4169-b76a-17886e64bdc7 1G" returned: 0 in 0.441s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9af44191-0206-4736-853e-e0efb18e247f tempest-SnapshotDependencyTests-1561085721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.20559c2a-0f02-4169-b76a-17886e64bdc7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:36 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.20559c2a-0f02-4169-b76a-17886e64bdc7 Apr 21 21:00:36 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:37 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9af44191-0206-4736-853e-e0efb18e247f tempest-SnapshotDependencyTests-1561085721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.20559c2a-0f02-4169-b76a-17886e64bdc7" returned: 0 in 0.413s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:37 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-9af44191-0206-4736-853e-e0efb18e247f tempest-SnapshotDependencyTests-1561085721 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.20559c2a-0f02-4169-b76a-17886e64bdc7 is being set with open permissions: ugo+rw Apr 21 21:00:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9af44191-0206-4736-853e-e0efb18e247f tempest-SnapshotDependencyTests-1561085721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.20559c2a-0f02-4169-b76a-17886e64bdc7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:37 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.20559c2a-0f02-4169-b76a-17886e64bdc7 Apr 21 21:00:37 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:37 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9af44191-0206-4736-853e-e0efb18e247f tempest-SnapshotDependencyTests-1561085721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.20559c2a-0f02-4169-b76a-17886e64bdc7" returned: 0 in 0.380s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9af44191-0206-4736-853e-e0efb18e247f tempest-SnapshotDependencyTests-1561085721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:37 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.info Apr 21 21:00:37 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:37 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9af44191-0206-4736-853e-e0efb18e247f tempest-SnapshotDependencyTests-1561085721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.info" returned: 0 in 0.388s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:37 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-9af44191-0206-4736-853e-e0efb18e247f tempest-SnapshotDependencyTests-1561085721 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.info is being set with open permissions: ugo+rw Apr 21 21:00:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9af44191-0206-4736-853e-e0efb18e247f tempest-SnapshotDependencyTests-1561085721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:37 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.info Apr 21 21:00:37 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:38 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9af44191-0206-4736-853e-e0efb18e247f tempest-SnapshotDependencyTests-1561085721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.info" returned: 0 in 0.393s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9af44191-0206-4736-853e-e0efb18e247f tempest-SnapshotDependencyTests-1561085721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.514s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:38 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-9af44191-0206-4736-853e-e0efb18e247f tempest-SnapshotDependencyTests-1561085721 None] Create snapshot completed successfully Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Flow 'volume_create_manager' (c8d6460a-4ae3-47c9-bad4-817b08d5f8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d449baf6-f854-4711-894c-936b74b915dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d449baf6-f854-4711-894c-936b74b915dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19939ed3-c839-4d86-940f-864238785ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a493796e2947c68e262949de05c7c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=20559c2a-0f02-4169-b76a-17886e64bdc7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:39Z,use_quota=True,user_id='a3b5f05de4d5461e9154bafd25c3249f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad49fcdd-1a2a-41f4-ad4b-48cad5590992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad49fcdd-1a2a-41f4-ad4b-48cad5590992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cbe8dc-4ae2-4dfb-b452-832c8c9c5f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cbe8dc-4ae2-4dfb-b452-832c8c9c5f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '19939ed3-c839-4d86-940f-864238785ec5', 'volume_name': 'volume-19939ed3-c839-4d86-940f-864238785ec5', 'volume_size': 1, 'snapshot_id': '20559c2a-0f02-4169-b76a-17886e64bdc7'}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd30ab66-7566-4f8c-8556-44c12d898959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd30ab66-7566-4f8c-8556-44c12d898959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed53f05a-031f-4fc8-9dd4-0b4d7c1f8117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:39 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Volume 19939ed3-c839-4d86-940f-864238785ec5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-19939ed3-c839-4d86-940f-864238785ec5', 'volume_size': 1, 'snapshot_id': '20559c2a-0f02-4169-b76a-17886e64bdc7'} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Acquiring lock "cinder-quobyte-20559c2a-0f02-4169-b76a-17886e64bdc7-19939ed3-c839-4d86-940f-864238785ec5" by "_create_volume_from_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Lock "cinder-quobyte-20559c2a-0f02-4169-b76a-17886e64bdc7-19939ed3-c839-4d86-940f-864238785ec5" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Creating volume 19939ed3-c839-4d86-940f-864238785ec5 from snapshot 20559c2a-0f02-4169-b76a-17886e64bdc7 {{(pid=81957) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Acquiring lock "cinder-quobyte-19939ed3-c839-4d86-940f-864238785ec5" by "_copy_volume_from_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Lock "cinder-quobyte-19939ed3-c839-4d86-940f-864238785ec5" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] snapshot: 20559c2a-0f02-4169-b76a-17886e64bdc7, volume: 19939ed3-c839-4d86-940f-864238785ec5, {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[421bf762-1aae-4280-a9c4-8dc9e0899d19]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.20559c2a-0f02-4169-b76a-17886e64bdc7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:39 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.20559c2a-0f02-4169-b76a-17886e64bdc7 Apr 21 21:00:39 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:39 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.20559c2a-0f02-4169-b76a-17886e64bdc7" returned: 0 in 0.460s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Creating direct copy from snapshot {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51dc4bd-4934-4051-b01c-a4af1da0c872]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:39 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 Apr 21 21:00:39 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:40 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6" returned: 0 in 0.494s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:40 devstack cinder-volume[81957]: DEBUG cinder.utils [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Path /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-19939ed3-c839-4d86-940f-864238785ec5 not found in is_blk_device check {{(pid=81957) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 21:00:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-19939ed3-c839-4d86-940f-864238785ec5 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:40 devstack sudo[89939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-19939ed3-c839-4d86-940f-864238785ec5 Apr 21 21:00:40 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:42 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-19939ed3-c839-4d86-940f-864238785ec5" returned: 0 in 1.743s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:42 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cfe72e-0285-4152-8921-9aaaa6422633]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:42 devstack sudo[89951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 Apr 21 21:00:42 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:42 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6" returned: 0 in 0.562s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:42 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6, size 1024.00 MB, duration 1.74 sec, destination /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-19939ed3-c839-4d86-940f-864238785ec5 {{(pid=81957) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 21:00:42 devstack cinder-volume[81957]: INFO cinder.image.image_utils [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Converted 1024.00 MB image at 587.08 MB/s Apr 21 21:00:42 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-19939ed3-c839-4d86-940f-864238785ec5 is being set with open permissions: ugo+rw Apr 21 21:00:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-19939ed3-c839-4d86-940f-864238785ec5 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:42 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-19939ed3-c839-4d86-940f-864238785ec5 Apr 21 21:00:42 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:43 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-19939ed3-c839-4d86-940f-864238785ec5" returned: 0 in 0.379s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Lock "cinder-quobyte-19939ed3-c839-4d86-940f-864238785ec5" released by "_copy_volume_from_snapshot" :: held 3.690s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Lock "cinder-quobyte-20559c2a-0f02-4169-b76a-17886e64bdc7-19939ed3-c839-4d86-940f-864238785ec5" released by "_create_volume_from_snapshot" :: held 3.711s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.723s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed53f05a-031f-4fc8-9dd4-0b4d7c1f8117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19939ed3-c839-4d86-940f-864238785ec5', 'volume_size': 1, 'snapshot_id': '20559c2a-0f02-4169-b76a-17886e64bdc7'}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1476859-dc74-4286-89a9-fda36bdd9f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:43 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Volume volume-19939ed3-c839-4d86-940f-864238785ec5 (19939ed3-c839-4d86-940f-864238785ec5): created successfully Apr 21 21:00:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1476859-dc74-4286-89a9-fda36bdd9f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:43 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Flow 'volume_create_manager' (c8d6460a-4ae3-47c9-bad4-817b08d5f8dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:43 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-f67b6247-fd42-4de8-a0a2-1721a3a3b0b2 tempest-SnapshotDependencyTests-1561085721 None] Created volume successfully. Apr 21 21:00:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2ba9b1f4-509e-491f-aa1f-ffc5d3be7260 tempest-SnapshotDependencyTests-1561085721 None] Acquiring lock "cinder-20559c2a-0f02-4169-b76a-17886e64bdc7-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2ba9b1f4-509e-491f-aa1f-ffc5d3be7260 tempest-SnapshotDependencyTests-1561085721 None] Lock "cinder-20559c2a-0f02-4169-b76a-17886e64bdc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2ba9b1f4-509e-491f-aa1f-ffc5d3be7260 tempest-SnapshotDependencyTests-1561085721 None] Acquiring lock "cinder-quobyte-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2ba9b1f4-509e-491f-aa1f-ffc5d3be7260 tempest-SnapshotDependencyTests-1561085721 None] Lock "cinder-quobyte-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2ba9b1f4-509e-491f-aa1f-ffc5d3be7260 tempest-SnapshotDependencyTests-1561085721 None] Acquiring lock "cinder-quobyte-20559c2a-0f02-4169-b76a-17886e64bdc7" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2ba9b1f4-509e-491f-aa1f-ffc5d3be7260 tempest-SnapshotDependencyTests-1561085721 None] Lock "cinder-quobyte-20559c2a-0f02-4169-b76a-17886e64bdc7" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-2ba9b1f4-509e-491f-aa1f-ffc5d3be7260 tempest-SnapshotDependencyTests-1561085721 None] Deleting offline snapshot 20559c2a-0f02-4169-b76a-17886e64bdc7 of volume 9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:00:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-2ba9b1f4-509e-491f-aa1f-ffc5d3be7260 tempest-SnapshotDependencyTests-1561085721 None] snapshot_file for this snap is: volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.20559c2a-0f02-4169-b76a-17886e64bdc7 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:00:43 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63caeb1-22cb-4fa2-9e49-df954fe00229]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2ba9b1f4-509e-491f-aa1f-ffc5d3be7260 tempest-SnapshotDependencyTests-1561085721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.20559c2a-0f02-4169-b76a-17886e64bdc7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:43 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.20559c2a-0f02-4169-b76a-17886e64bdc7 Apr 21 21:00:43 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:43 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2ba9b1f4-509e-491f-aa1f-ffc5d3be7260 tempest-SnapshotDependencyTests-1561085721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.20559c2a-0f02-4169-b76a-17886e64bdc7" returned: 0 in 0.449s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-2ba9b1f4-509e-491f-aa1f-ffc5d3be7260 tempest-SnapshotDependencyTests-1561085721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:00:44 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51e560f-d8c8-4e26-bb7d-a81f0cf614d0]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2ba9b1f4-509e-491f-aa1f-ffc5d3be7260 tempest-SnapshotDependencyTests-1561085721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:44 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 Apr 21 21:00:44 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:44 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2ba9b1f4-509e-491f-aa1f-ffc5d3be7260 tempest-SnapshotDependencyTests-1561085721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6" returned: 0 in 0.456s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2ba9b1f4-509e-491f-aa1f-ffc5d3be7260 tempest-SnapshotDependencyTests-1561085721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.20559c2a-0f02-4169-b76a-17886e64bdc7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:44 devstack sudo[89969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.20559c2a-0f02-4169-b76a-17886e64bdc7 Apr 21 21:00:44 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:44 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2ba9b1f4-509e-491f-aa1f-ffc5d3be7260 tempest-SnapshotDependencyTests-1561085721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.20559c2a-0f02-4169-b76a-17886e64bdc7" returned: 0 in 0.426s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2ba9b1f4-509e-491f-aa1f-ffc5d3be7260 tempest-SnapshotDependencyTests-1561085721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.20559c2a-0f02-4169-b76a-17886e64bdc7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:44 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.20559c2a-0f02-4169-b76a-17886e64bdc7 Apr 21 21:00:44 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:45 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2ba9b1f4-509e-491f-aa1f-ffc5d3be7260 tempest-SnapshotDependencyTests-1561085721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6.20559c2a-0f02-4169-b76a-17886e64bdc7" returned: 0 in 0.380s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:45 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2ba9b1f4-509e-491f-aa1f-ffc5d3be7260 tempest-SnapshotDependencyTests-1561085721 None] Lock "cinder-quobyte-20559c2a-0f02-4169-b76a-17886e64bdc7" released by "_delete_snapshot" :: held 1.759s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:45 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2ba9b1f4-509e-491f-aa1f-ffc5d3be7260 tempest-SnapshotDependencyTests-1561085721 None] Lock "cinder-quobyte-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6" released by "delete_snapshot" :: held 1.771s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:45 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-2ba9b1f4-509e-491f-aa1f-ffc5d3be7260 tempest-SnapshotDependencyTests-1561085721 None] Created reservations ['2570d0e7-10a3-4e48-8c36-ce04c3cc906c', 'dc07cfd7-3ba0-4bae-8503-eb396b95cbab', '8a0a097c-24c5-4e36-a8c4-2e25289bd9f8', '0f8e26fb-ed89-4b8b-bb1e-ac91bec4d33c'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:45 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-2ba9b1f4-509e-491f-aa1f-ffc5d3be7260 tempest-SnapshotDependencyTests-1561085721 None] Delete snapshot completed successfully. Apr 21 21:00:45 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2ba9b1f4-509e-491f-aa1f-ffc5d3be7260 tempest-SnapshotDependencyTests-1561085721 None] Lock "cinder-20559c2a-0f02-4169-b76a-17886e64bdc7-delete_snapshot" released by "delete_snapshot" :: held 1.847s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:45 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-71a41aa9-5ae5-4b8b-8690-e30d3d6e63ea tempest-SnapshotDependencyTests-1561085721 None] Acquiring lock "cinder-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:45 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-71a41aa9-5ae5-4b8b-8690-e30d3d6e63ea tempest-SnapshotDependencyTests-1561085721 None] Lock "cinder-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:45 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-71a41aa9-5ae5-4b8b-8690-e30d3d6e63ea tempest-SnapshotDependencyTests-1561085721 None] Acquiring lock "cinder-quobyte-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:45 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-71a41aa9-5ae5-4b8b-8690-e30d3d6e63ea tempest-SnapshotDependencyTests-1561085721 None] Lock "cinder-quobyte-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:45 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[be29311e-cca9-43ad-acaf-1a6c8ae210e6]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-71a41aa9-5ae5-4b8b-8690-e30d3d6e63ea tempest-SnapshotDependencyTests-1561085721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:45 devstack sudo[89977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 Apr 21 21:00:45 devstack sudo[89977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:46 devstack sudo[89977]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-71a41aa9-5ae5-4b8b-8690-e30d3d6e63ea tempest-SnapshotDependencyTests-1561085721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6" returned: 0 in 0.444s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-71a41aa9-5ae5-4b8b-8690-e30d3d6e63ea tempest-SnapshotDependencyTests-1561085721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:46 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6 Apr 21 21:00:46 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:46 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-71a41aa9-5ae5-4b8b-8690-e30d3d6e63ea tempest-SnapshotDependencyTests-1561085721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6" returned: 0 in 0.388s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-71a41aa9-5ae5-4b8b-8690-e30d3d6e63ea tempest-SnapshotDependencyTests-1561085721 None] Lock "cinder-quobyte-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6" released by "delete_volume" :: held 0.869s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:46 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-71a41aa9-5ae5-4b8b-8690-e30d3d6e63ea tempest-SnapshotDependencyTests-1561085721 None] Created reservations ['47bc5671-3d28-479b-be7b-ef8cf35ba17b', '04182ff9-d1e3-4c7a-8e86-e81d4d39f394', '7ca44dab-9a56-4394-9de3-97b5863cddc7', '899ca685-1d36-4579-a666-77c2dae86f04'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-71a41aa9-5ae5-4b8b-8690-e30d3d6e63ea tempest-SnapshotDependencyTests-1561085721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-71a41aa9-5ae5-4b8b-8690-e30d3d6e63ea tempest-SnapshotDependencyTests-1561085721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-71a41aa9-5ae5-4b8b-8690-e30d3d6e63ea tempest-SnapshotDependencyTests-1561085721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-71a41aa9-5ae5-4b8b-8690-e30d3d6e63ea tempest-SnapshotDependencyTests-1561085721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-71a41aa9-5ae5-4b8b-8690-e30d3d6e63ea tempest-SnapshotDependencyTests-1561085721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-71a41aa9-5ae5-4b8b-8690-e30d3d6e63ea tempest-SnapshotDependencyTests-1561085721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:46 devstack sudo[89985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:00:46 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5e547a61-1c1c-42a5-a49a-0c3c7148b826 tempest-SnapshotDependencyTests-1561085721 None] Acquiring lock "cinder-19939ed3-c839-4d86-940f-864238785ec5-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5e547a61-1c1c-42a5-a49a-0c3c7148b826 tempest-SnapshotDependencyTests-1561085721 None] Lock "cinder-19939ed3-c839-4d86-940f-864238785ec5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5e547a61-1c1c-42a5-a49a-0c3c7148b826 tempest-SnapshotDependencyTests-1561085721 None] Acquiring lock "cinder-quobyte-19939ed3-c839-4d86-940f-864238785ec5" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5e547a61-1c1c-42a5-a49a-0c3c7148b826 tempest-SnapshotDependencyTests-1561085721 None] Lock "cinder-quobyte-19939ed3-c839-4d86-940f-864238785ec5" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:46 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[8424528b-62d0-45cb-93a3-f5ff647d8b38]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5e547a61-1c1c-42a5-a49a-0c3c7148b826 tempest-SnapshotDependencyTests-1561085721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-19939ed3-c839-4d86-940f-864238785ec5 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:46 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-19939ed3-c839-4d86-940f-864238785ec5 Apr 21 21:00:46 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:46 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-71a41aa9-5ae5-4b8b-8690-e30d3d6e63ea tempest-SnapshotDependencyTests-1561085721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.415s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:46 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-71a41aa9-5ae5-4b8b-8690-e30d3d6e63ea tempest-SnapshotDependencyTests-1561085721 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:46 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-71a41aa9-5ae5-4b8b-8690-e30d3d6e63ea tempest-SnapshotDependencyTests-1561085721 None] Deleted volume successfully. Apr 21 21:00:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-71a41aa9-5ae5-4b8b-8690-e30d3d6e63ea tempest-SnapshotDependencyTests-1561085721 None] Lock "cinder-9eb07ce1-19b3-4f08-99b2-fd9bac3245f6-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:47 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5e547a61-1c1c-42a5-a49a-0c3c7148b826 tempest-SnapshotDependencyTests-1561085721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-19939ed3-c839-4d86-940f-864238785ec5" returned: 0 in 0.455s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5e547a61-1c1c-42a5-a49a-0c3c7148b826 tempest-SnapshotDependencyTests-1561085721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-19939ed3-c839-4d86-940f-864238785ec5 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:47 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-19939ed3-c839-4d86-940f-864238785ec5 Apr 21 21:00:47 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:47 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5e547a61-1c1c-42a5-a49a-0c3c7148b826 tempest-SnapshotDependencyTests-1561085721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-19939ed3-c839-4d86-940f-864238785ec5" returned: 0 in 0.375s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5e547a61-1c1c-42a5-a49a-0c3c7148b826 tempest-SnapshotDependencyTests-1561085721 None] Lock "cinder-quobyte-19939ed3-c839-4d86-940f-864238785ec5" released by "delete_volume" :: held 0.849s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:47 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-5e547a61-1c1c-42a5-a49a-0c3c7148b826 tempest-SnapshotDependencyTests-1561085721 None] Created reservations ['b96ae061-a3d4-464f-99d3-44cee047e1fd', '585732bc-a8a5-41a7-9416-52de574a2cc8', 'ed3c7246-50f2-4a1e-a74c-477a568c4731', '4fb94373-787d-41e4-851d-f9e88185f827'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5e547a61-1c1c-42a5-a49a-0c3c7148b826 tempest-SnapshotDependencyTests-1561085721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5e547a61-1c1c-42a5-a49a-0c3c7148b826 tempest-SnapshotDependencyTests-1561085721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5e547a61-1c1c-42a5-a49a-0c3c7148b826 tempest-SnapshotDependencyTests-1561085721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5e547a61-1c1c-42a5-a49a-0c3c7148b826 tempest-SnapshotDependencyTests-1561085721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5e547a61-1c1c-42a5-a49a-0c3c7148b826 tempest-SnapshotDependencyTests-1561085721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5e547a61-1c1c-42a5-a49a-0c3c7148b826 tempest-SnapshotDependencyTests-1561085721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:47 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:00:47 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:48 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5e547a61-1c1c-42a5-a49a-0c3c7148b826 tempest-SnapshotDependencyTests-1561085721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.378s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:48 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-5e547a61-1c1c-42a5-a49a-0c3c7148b826 tempest-SnapshotDependencyTests-1561085721 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:48 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-5e547a61-1c1c-42a5-a49a-0c3c7148b826 tempest-SnapshotDependencyTests-1561085721 None] Deleted volume successfully. Apr 21 21:00:48 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5e547a61-1c1c-42a5-a49a-0c3c7148b826 tempest-SnapshotDependencyTests-1561085721 None] Lock "cinder-19939ed3-c839-4d86-940f-864238785ec5-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:53 devstack cinder-volume[81957]: DEBUG oslo_service.periodic_task [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81957) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 21:00:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:53 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:00:53 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:54 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.453s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:54 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:57 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:SELECT=24,cinder:UPDATE=39,cinder:DELETE=2,cinder:INSERT=5 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:00:58 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:SELECT=24,cinder:UPDATE=18,cinder:INSERT=9,cinder:DELETE=3 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Flow 'volume_create_manager' (4640dfb2-b33e-4d15-9de7-4682fcb1d60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acba8027-e796-445b-a905-ba2507c5dfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acba8027-e796-445b-a905-ba2507c5dfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-786613200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15eba763-be1e-486b-a914-5150c64b7d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772bfc67b6064a3b8c2ca66371ab1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:59Z,use_quota=True,user_id='88979408a2334af0adcd2600b4f78ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71d090a-8c5a-4523-99bb-b0610f2b203c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71d090a-8c5a-4523-99bb-b0610f2b203c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13415098-2d93-4cc0-b355-f0c3087b852d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13415098-2d93-4cc0-b355-f0c3087b852d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15eba763-be1e-486b-a914-5150c64b7d35', 'volume_name': 'volume-15eba763-be1e-486b-a914-5150c64b7d35', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9540a5-f9f4-4ec9-8ba5-32167fc3745e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9540a5-f9f4-4ec9-8ba5-32167fc3745e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6433097f-f771-44c1-967a-3e58eab70044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:59 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Volume 15eba763-be1e-486b-a914-5150c64b7d35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15eba763-be1e-486b-a914-5150c64b7d35', 'volume_size': 1} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-786613200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15eba763-be1e-486b-a914-5150c64b7d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772bfc67b6064a3b8c2ca66371ab1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:59Z,use_quota=True,user_id='88979408a2334af0adcd2600b4f78ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Creating volume 15eba763-be1e-486b-a914-5150c64b7d35 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:59 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:59 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35 1073741824 Apr 21 21:00:59 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Flow 'volume_create_manager' (7a5e18f9-212d-4661-8cee-c09359ffa0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82012e29-e58e-4eea-be60-2143759fefb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82012e29-e58e-4eea-be60-2143759fefb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-903538708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0daaeb98-668d-4d83-8a42-03ed5e214ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='990e76bea3b5471b8ea4aeaa9c902fdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:00Z,use_quota=True,user_id='8088ea50ab7a444b872d62cf6f480937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d726b2-2bba-4624-aa92-d949d947bc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d726b2-2bba-4624-aa92-d949d947bc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cca66dc-4902-40e9-940c-412862dbfc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cca66dc-4902-40e9-940c-412862dbfc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0daaeb98-668d-4d83-8a42-03ed5e214ddf', 'volume_name': 'volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21996e33-bfba-4495-bf04-c5cbcf52b7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21996e33-bfba-4495-bf04-c5cbcf52b7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c73946-85af-4195-96b2-fb5819b11df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:59 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Volume 0daaeb98-668d-4d83-8a42-03ed5e214ddf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf', 'volume_size': 1} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Flow 'volume_create_manager' (d018a2b1-1c5e-485c-aef3-1671d75fdc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281108d7-206e-4a24-971d-fd61a20198a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281108d7-206e-4a24-971d-fd61a20198a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-625438508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed97013-c11d-46aa-b77f-8e8e7f483cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937d1016fea045d1bd3c698a20a106c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:00Z,use_quota=True,user_id='6d69887d036f4e08acb4130803589524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b54170-ffce-40b4-a012-b2f7c8514786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b54170-ffce-40b4-a012-b2f7c8514786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24789b74-35d1-4c21-bb2b-4bac6c7a37da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24789b74-35d1-4c21-bb2b-4bac6c7a37da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ed97013-c11d-46aa-b77f-8e8e7f483cdd', 'volume_name': 'volume-9ed97013-c11d-46aa-b77f-8e8e7f483cdd', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be213a0c-da5c-4bdf-928b-defe9ea28077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be213a0c-da5c-4bdf-928b-defe9ea28077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf7e97c-1f01-4bb8-a7be-a6f7b49185f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:59 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Volume 9ed97013-c11d-46aa-b77f-8e8e7f483cdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ed97013-c11d-46aa-b77f-8e8e7f483cdd', 'volume_size': 1} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Flow 'volume_create_manager' (2497b8de-f5ca-4e65-bbb3-a6437ad3c334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:59 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20e54df-2444-401c-8ad9-08971e398e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20e54df-2444-401c-8ad9-08971e398e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1089523415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64301e98-49ab-4d99-872b-dddc4e7bb665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937d1016fea045d1bd3c698a20a106c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:00Z,use_quota=True,user_id='6d69887d036f4e08acb4130803589524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ee52fb-1730-4373-984e-ccd270127c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ee52fb-1730-4373-984e-ccd270127c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6bf5aca-0688-44bc-9579-14b77f4bda16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6bf5aca-0688-44bc-9579-14b77f4bda16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64301e98-49ab-4d99-872b-dddc4e7bb665', 'volume_name': 'volume-64301e98-49ab-4d99-872b-dddc4e7bb665', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e28f6fbe-6c7c-4ca5-89e5-aaaed16daa76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e28f6fbe-6c7c-4ca5-89e5-aaaed16daa76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52d6950-6ece-40f7-876f-b718d33d3ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Volume 64301e98-49ab-4d99-872b-dddc4e7bb665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64301e98-49ab-4d99-872b-dddc4e7bb665', 'volume_size': 1} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:00 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Flow 'volume_create_manager' (57d1711e-c745-435a-abba-a5bd14a7a086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1b227d-f396-496a-b706-6bbc70c5e57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35 1073741824" returned: 0 in 0.682s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1b227d-f396-496a-b706-6bbc70c5e57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-922905730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70da106-f2a1-422f-8ed3-0f00140e16da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937d1016fea045d1bd3c698a20a106c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:00Z,use_quota=True,user_id='6d69887d036f4e08acb4130803589524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34420e14-e87a-45f7-9fe9-8b65d344e344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34420e14-e87a-45f7-9fe9-8b65d344e344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046c2cd7-36a9-40cf-83c3-a6a9aa5af056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046c2cd7-36a9-40cf-83c3-a6a9aa5af056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f70da106-f2a1-422f-8ed3-0f00140e16da', 'volume_name': 'volume-f70da106-f2a1-422f-8ed3-0f00140e16da', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06462fe3-9efa-401d-ab18-5c7d71ae8c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06462fe3-9efa-401d-ab18-5c7d71ae8c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be798756-92f6-4900-b3e8-52f7bf904de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Volume f70da106-f2a1-422f-8ed3-0f00140e16da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f70da106-f2a1-422f-8ed3-0f00140e16da', 'volume_size': 1} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:00 devstack sudo[90089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35 Apr 21 21:01:00 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Flow 'volume_create_manager' (5bea851d-ce5d-4184-b288-00a8795e0635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44fd176a-0a93-42bb-b4b2-d281efc2719b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44fd176a-0a93-42bb-b4b2-d281efc2719b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1791000659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937d1016fea045d1bd3c698a20a106c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:00Z,use_quota=True,user_id='6d69887d036f4e08acb4130803589524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d2fc77-91ae-4b26-b381-f77ffcb2083a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d2fc77-91ae-4b26-b381-f77ffcb2083a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75badfb5-4b4c-4d0d-ae7b-bd803e09cd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75badfb5-4b4c-4d0d-ae7b-bd803e09cd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1', 'volume_name': 'volume-5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b284f5ea-26cb-4642-8987-de5499d65ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b284f5ea-26cb-4642-8987-de5499d65ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124d14c2-431c-4734-864b-ec3992a2f0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Volume 5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1', 'volume_size': 1} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Flow 'volume_create_manager' (401c2159-f542-46bc-b1d4-c79f893bdd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (240029eb-bf09-40f6-96e4-6a1f4db182e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (240029eb-bf09-40f6-96e4-6a1f4db182e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1411038668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937d1016fea045d1bd3c698a20a106c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:01Z,use_quota=True,user_id='6d69887d036f4e08acb4130803589524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb95900-776e-4e69-8f83-bec4c8d9bb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb95900-776e-4e69-8f83-bec4c8d9bb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0bf93a-fe25-471c-ac08-853fa6f94249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0bf93a-fe25-471c-ac08-853fa6f94249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe', 'volume_name': 'volume-4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6348cc0-9949-4608-9385-eb575d2183eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6348cc0-9949-4608-9385-eb575d2183eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (920e66ed-1e79-4673-9602-c5bf22f30384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Volume 4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe', 'volume_size': 1} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:00 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35" returned: 0 in 0.575s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.189s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-903538708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0daaeb98-668d-4d83-8a42-03ed5e214ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='990e76bea3b5471b8ea4aeaa9c902fdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:00Z,use_quota=True,user_id='8088ea50ab7a444b872d62cf6f480937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Creating volume 0daaeb98-668d-4d83-8a42-03ed5e214ddf {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:00 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:00 devstack sudo[90093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf 1073741824 Apr 21 21:01:00 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6433097f-f771-44c1-967a-3e58eab70044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15eba763-be1e-486b-a914-5150c64b7d35', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:00 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c076384-8e1f-4591-a40f-85407cf5ad5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:01 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Volume volume-15eba763-be1e-486b-a914-5150c64b7d35 (15eba763-be1e-486b-a914-5150c64b7d35): created successfully Apr 21 21:01:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c076384-8e1f-4591-a40f-85407cf5ad5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Flow 'volume_create_manager' (4640dfb2-b33e-4d15-9de7-4682fcb1d60c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:01 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-831751b5-de54-4e6e-b30b-21ae76fc1354 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Created volume successfully. Apr 21 21:01:01 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf 1073741824" returned: 0 in 0.563s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:01 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf Apr 21 21:01:01 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-87a5c012-21d9-4ca7-a438-496c2bcd9cce tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:01 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf" returned: 0 in 0.458s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.118s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-625438508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed97013-c11d-46aa-b77f-8e8e7f483cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937d1016fea045d1bd3c698a20a106c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:00Z,use_quota=True,user_id='6d69887d036f4e08acb4130803589524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Creating volume 9ed97013-c11d-46aa-b77f-8e8e7f483cdd {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:01 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:01 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:01:01 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ed97013-c11d-46aa-b77f-8e8e7f483cdd 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c73946-85af-4195-96b2-fb5819b11df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:01 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ed97013-c11d-46aa-b77f-8e8e7f483cdd 1073741824 Apr 21 21:01:01 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:01 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca2b61a-9af5-454f-a1fc-5669a1a72a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:01 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Volume volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf (0daaeb98-668d-4d83-8a42-03ed5e214ddf): created successfully Apr 21 21:01:02 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca2b61a-9af5-454f-a1fc-5669a1a72a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:02 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Flow 'volume_create_manager' (7a5e18f9-212d-4661-8cee-c09359ffa0f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:02 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-b45b81ff-0ec4-4789-acfb-b785c9f4b119 tempest-VolumeDependencyTests-1493625113 None] Created volume successfully. Apr 21 21:01:02 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ed97013-c11d-46aa-b77f-8e8e7f483cdd 1073741824" returned: 0 in 0.586s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ed97013-c11d-46aa-b77f-8e8e7f483cdd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:02 devstack sudo[90106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ed97013-c11d-46aa-b77f-8e8e7f483cdd Apr 21 21:01:02 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:02 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-178da9c5-5966-4919-9a7f-65bc6b8de982 tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:03 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ed97013-c11d-46aa-b77f-8e8e7f483cdd" returned: 0 in 0.507s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.021s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1089523415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64301e98-49ab-4d99-872b-dddc4e7bb665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937d1016fea045d1bd3c698a20a106c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:00Z,use_quota=True,user_id='6d69887d036f4e08acb4130803589524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Creating volume 64301e98-49ab-4d99-872b-dddc4e7bb665 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:03 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:03 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:01:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-64301e98-49ab-4d99-872b-dddc4e7bb665 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:03 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-64301e98-49ab-4d99-872b-dddc4e7bb665 1073741824 Apr 21 21:01:03 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:03 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf7e97c-1f01-4bb8-a7be-a6f7b49185f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed97013-c11d-46aa-b77f-8e8e7f483cdd', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:03 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f144326c-f9d8-4761-b601-a9a07ea41544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:03 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Volume volume-9ed97013-c11d-46aa-b77f-8e8e7f483cdd (9ed97013-c11d-46aa-b77f-8e8e7f483cdd): created successfully Apr 21 21:01:03 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f144326c-f9d8-4761-b601-a9a07ea41544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:03 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Flow 'volume_create_manager' (d018a2b1-1c5e-485c-aef3-1671d75fdc02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:03 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-cccb8410-addd-4076-b0e3-aacd7b5b9768 tempest-CreateVolumesFromImageTest-1417329816 None] Created volume successfully. Apr 21 21:01:03 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-64301e98-49ab-4d99-872b-dddc4e7bb665 1073741824" returned: 0 in 0.630s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:03 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-64301e98-49ab-4d99-872b-dddc4e7bb665 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:03 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-64301e98-49ab-4d99-872b-dddc4e7bb665 Apr 21 21:01:03 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:04 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-64301e98-49ab-4d99-872b-dddc4e7bb665" returned: 0 in 0.499s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.982s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-922905730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70da106-f2a1-422f-8ed3-0f00140e16da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937d1016fea045d1bd3c698a20a106c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:00Z,use_quota=True,user_id='6d69887d036f4e08acb4130803589524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Creating volume f70da106-f2a1-422f-8ed3-0f00140e16da {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:04 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:04 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:01:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f70da106-f2a1-422f-8ed3-0f00140e16da 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52d6950-6ece-40f7-876f-b718d33d3ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64301e98-49ab-4d99-872b-dddc4e7bb665', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3d3e5c-24b4-426a-933f-1507474a528c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:04 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Volume volume-64301e98-49ab-4d99-872b-dddc4e7bb665 (64301e98-49ab-4d99-872b-dddc4e7bb665): created successfully Apr 21 21:01:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3d3e5c-24b4-426a-933f-1507474a528c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:04 devstack sudo[90117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f70da106-f2a1-422f-8ed3-0f00140e16da 1073741824 Apr 21 21:01:04 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:04 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Flow 'volume_create_manager' (2497b8de-f5ca-4e65-bbb3-a6437ad3c334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:04 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-d83789de-9fa8-4e36-95cb-a454fe688d83 tempest-CreateVolumesFromImageTest-1417329816 None] Created volume successfully. Apr 21 21:01:04 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f70da106-f2a1-422f-8ed3-0f00140e16da 1073741824" returned: 0 in 0.529s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:04 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f70da106-f2a1-422f-8ed3-0f00140e16da {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:04 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f70da106-f2a1-422f-8ed3-0f00140e16da Apr 21 21:01:04 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:05 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f70da106-f2a1-422f-8ed3-0f00140e16da" returned: 0 in 0.447s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:05 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.787s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:05 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1791000659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937d1016fea045d1bd3c698a20a106c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:00Z,use_quota=True,user_id='6d69887d036f4e08acb4130803589524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:05 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Creating volume 5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:05 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:05 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:05 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:05 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:01:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:05 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be798756-92f6-4900-b3e8-52f7bf904de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f70da106-f2a1-422f-8ed3-0f00140e16da', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:05 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff57f991-00a1-4fd0-899e-f6a1a3423dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:05 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1 1073741824 Apr 21 21:01:05 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:05 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Volume volume-f70da106-f2a1-422f-8ed3-0f00140e16da (f70da106-f2a1-422f-8ed3-0f00140e16da): created successfully Apr 21 21:01:05 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff57f991-00a1-4fd0-899e-f6a1a3423dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:05 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Flow 'volume_create_manager' (57d1711e-c745-435a-abba-a5bd14a7a086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:05 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-39bd4619-5d59-4546-8310-2e750ade95ac tempest-CreateVolumesFromImageTest-1417329816 None] Created volume successfully. Apr 21 21:01:05 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1 1073741824" returned: 0 in 0.545s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:05 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:05 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1 Apr 21 21:01:05 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:06 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1" returned: 0 in 0.462s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.579s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1411038668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937d1016fea045d1bd3c698a20a106c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:01Z,use_quota=True,user_id='6d69887d036f4e08acb4130803589524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Creating volume 4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:06 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:06 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:01:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124d14c2-431c-4734-864b-ec3992a2f0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:06 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe 1073741824 Apr 21 21:01:06 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b962da51-38cd-45de-882a-6f8687d0b4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:06 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Volume volume-5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1 (5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1): created successfully Apr 21 21:01:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b962da51-38cd-45de-882a-6f8687d0b4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:06 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Flow 'volume_create_manager' (5bea851d-ce5d-4184-b288-00a8795e0635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:06 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-472d83d9-acea-48b0-933e-148c26252538 tempest-CreateVolumesFromImageTest-1417329816 None] Created volume successfully. Apr 21 21:01:06 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe 1073741824" returned: 0 in 0.556s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:06 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:06 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe Apr 21 21:01:06 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:07 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe" returned: 0 in 0.462s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:07 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-87a5c012-21d9-4ca7-a438-496c2bcd9cce tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.672s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:07 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (920e66ed-1e79-4673-9602-c5bf22f30384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:07 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3f38ae3-fb90-4519-992b-04154be3fd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:07 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-87a5c012-21d9-4ca7-a438-496c2bcd9cce tempest-CreateVolumesFromSnapshotTest-1221784384 None] Creating offline snapshot cdca95a8-9546-4c6c-9be4-f55542eea9f1 of volume 15eba763-be1e-486b-a914-5150c64b7d35 {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:01:07 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Volume volume-4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe (4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe): created successfully Apr 21 21:01:07 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3f38ae3-fb90-4519-992b-04154be3fd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:07 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Flow 'volume_create_manager' (401c2159-f542-46bc-b1d4-c79f893bdd5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:07 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea85d87-b6fb-437e-96e7-78008375060a]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-87a5c012-21d9-4ca7-a438-496c2bcd9cce tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:07 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-46cd8e7b-4343-4c0a-952e-f72a1ced368b tempest-CreateVolumesFromImageTest-1417329816 None] Created volume successfully. Apr 21 21:01:07 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35 Apr 21 21:01:07 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:07 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-87a5c012-21d9-4ca7-a438-496c2bcd9cce tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35" returned: 0 in 0.462s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:07 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-87a5c012-21d9-4ca7-a438-496c2bcd9cce tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.cdca95a8-9546-4c6c-9be4-f55542eea9f1 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:07 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.cdca95a8-9546-4c6c-9be4-f55542eea9f1 1G Apr 21 21:01:07 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:08 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-87a5c012-21d9-4ca7-a438-496c2bcd9cce tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.cdca95a8-9546-4c6c-9be4-f55542eea9f1 1G" returned: 0 in 0.496s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-87a5c012-21d9-4ca7-a438-496c2bcd9cce tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15eba763-be1e-486b-a914-5150c64b7d35 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.cdca95a8-9546-4c6c-9be4-f55542eea9f1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:08 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15eba763-be1e-486b-a914-5150c64b7d35 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.cdca95a8-9546-4c6c-9be4-f55542eea9f1 Apr 21 21:01:08 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:08 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c9efae4f-60f3-4359-84df-05a7fb88b9b4 tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "cinder-4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:08 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c9efae4f-60f3-4359-84df-05a7fb88b9b4 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "cinder-4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:08 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c9efae4f-60f3-4359-84df-05a7fb88b9b4 tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "cinder-quobyte-4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:08 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c9efae4f-60f3-4359-84df-05a7fb88b9b4 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "cinder-quobyte-4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe" acquired by "delete_volume" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:08 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[109e92ba-b159-4fb1-8a88-d4595d263248]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c9efae4f-60f3-4359-84df-05a7fb88b9b4 tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:08 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe Apr 21 21:01:08 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:08 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-87a5c012-21d9-4ca7-a438-496c2bcd9cce tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15eba763-be1e-486b-a914-5150c64b7d35 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.cdca95a8-9546-4c6c-9be4-f55542eea9f1" returned: 0 in 0.476s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:08 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-87a5c012-21d9-4ca7-a438-496c2bcd9cce tempest-CreateVolumesFromSnapshotTest-1221784384 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.cdca95a8-9546-4c6c-9be4-f55542eea9f1 is being set with open permissions: ugo+rw Apr 21 21:01:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-87a5c012-21d9-4ca7-a438-496c2bcd9cce tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.cdca95a8-9546-4c6c-9be4-f55542eea9f1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:08 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.cdca95a8-9546-4c6c-9be4-f55542eea9f1 Apr 21 21:01:08 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:08 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c9efae4f-60f3-4359-84df-05a7fb88b9b4 tempest-CreateVolumesFromImageTest-1417329816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe" returned: 0 in 0.477s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:08 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c9efae4f-60f3-4359-84df-05a7fb88b9b4 tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:08 devstack sudo[90164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe Apr 21 21:01:08 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:09 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-87a5c012-21d9-4ca7-a438-496c2bcd9cce tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.cdca95a8-9546-4c6c-9be4-f55542eea9f1" returned: 0 in 0.430s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-87a5c012-21d9-4ca7-a438-496c2bcd9cce tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:09 devstack sudo[90168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.info Apr 21 21:01:09 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:09 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c9efae4f-60f3-4359-84df-05a7fb88b9b4 tempest-CreateVolumesFromImageTest-1417329816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe" returned: 0 in 0.432s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:09 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c9efae4f-60f3-4359-84df-05a7fb88b9b4 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "cinder-quobyte-4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe" released by "delete_volume" :: held 0.934s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:09 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-c9efae4f-60f3-4359-84df-05a7fb88b9b4 tempest-CreateVolumesFromImageTest-1417329816 None] Created reservations ['cfb0014b-241b-4a7e-9ab9-49894dbadd71', '11439a7b-ebe7-41b7-8d05-6649b297fdf1', 'f2717fa6-e361-420d-8003-4f271b9c1ac9', '5a587b44-9791-407a-8316-d167a5f44a39'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c9efae4f-60f3-4359-84df-05a7fb88b9b4 tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c9efae4f-60f3-4359-84df-05a7fb88b9b4 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:09 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c9efae4f-60f3-4359-84df-05a7fb88b9b4 tempest-CreateVolumesFromImageTest-1417329816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:09 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c9efae4f-60f3-4359-84df-05a7fb88b9b4 tempest-CreateVolumesFromImageTest-1417329816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c9efae4f-60f3-4359-84df-05a7fb88b9b4 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c9efae4f-60f3-4359-84df-05a7fb88b9b4 tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:09 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:09 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:09 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2f92688c-8a0d-4ef2-9fa5-3a280ede5287 tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "cinder-5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:09 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2f92688c-8a0d-4ef2-9fa5-3a280ede5287 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "cinder-5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:09 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2f92688c-8a0d-4ef2-9fa5-3a280ede5287 tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "cinder-quobyte-5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:09 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2f92688c-8a0d-4ef2-9fa5-3a280ede5287 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "cinder-quobyte-5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1" acquired by "delete_volume" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:09 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c859093-f53f-4018-8374-e7ff475b75c2]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2f92688c-8a0d-4ef2-9fa5-3a280ede5287 tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:09 devstack sudo[90172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1 Apr 21 21:01:09 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:09 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-87a5c012-21d9-4ca7-a438-496c2bcd9cce tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.info" returned: 0 in 0.525s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:09 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-87a5c012-21d9-4ca7-a438-496c2bcd9cce tempest-CreateVolumesFromSnapshotTest-1221784384 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.info is being set with open permissions: ugo+rw Apr 21 21:01:09 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-87a5c012-21d9-4ca7-a438-496c2bcd9cce tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:09 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.info Apr 21 21:01:09 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:10 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c9efae4f-60f3-4359-84df-05a7fb88b9b4 tempest-CreateVolumesFromImageTest-1417329816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.583s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:10 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-c9efae4f-60f3-4359-84df-05a7fb88b9b4 tempest-CreateVolumesFromImageTest-1417329816 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:10 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-c9efae4f-60f3-4359-84df-05a7fb88b9b4 tempest-CreateVolumesFromImageTest-1417329816 None] Deleted volume successfully. Apr 21 21:01:10 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c9efae4f-60f3-4359-84df-05a7fb88b9b4 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "cinder-4e3f1d88-7bfe-4401-9a6f-0aafe100d2fe-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:10 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2f92688c-8a0d-4ef2-9fa5-3a280ede5287 tempest-CreateVolumesFromImageTest-1417329816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1" returned: 0 in 0.612s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2f92688c-8a0d-4ef2-9fa5-3a280ede5287 tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:10 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1 Apr 21 21:01:10 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:10 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-87a5c012-21d9-4ca7-a438-496c2bcd9cce tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.info" returned: 0 in 0.434s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-87a5c012-21d9-4ca7-a438-496c2bcd9cce tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.899s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-178da9c5-5966-4919-9a7f-65bc6b8de982 tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.306s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-178da9c5-5966-4919-9a7f-65bc6b8de982 tempest-VolumeDependencyTests-1493625113 None] Creating offline snapshot e76e83fb-efd6-48e5-8a16-cc76b6f2c44f of volume 0daaeb98-668d-4d83-8a42-03ed5e214ddf {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:01:10 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-87a5c012-21d9-4ca7-a438-496c2bcd9cce tempest-CreateVolumesFromSnapshotTest-1221784384 None] Create snapshot completed successfully Apr 21 21:01:10 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc90a9e-d951-4b94-9d26-0f7275930edb]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-178da9c5-5966-4919-9a7f-65bc6b8de982 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:10 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf Apr 21 21:01:10 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:10 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2f92688c-8a0d-4ef2-9fa5-3a280ede5287 tempest-CreateVolumesFromImageTest-1417329816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1" returned: 0 in 0.480s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:10 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2f92688c-8a0d-4ef2-9fa5-3a280ede5287 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "cinder-quobyte-5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1" released by "delete_volume" :: held 1.114s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:10 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-2f92688c-8a0d-4ef2-9fa5-3a280ede5287 tempest-CreateVolumesFromImageTest-1417329816 None] Created reservations ['0f24497e-817c-4657-a404-8dd122b5dc76', 'f0dcc795-d94a-4854-96db-936eb8bfee6a', 'ef3b865b-5c42-48a4-af45-3bd7c0637def', '089c5e8e-cd75-4371-90e2-c158392550b8'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2f92688c-8a0d-4ef2-9fa5-3a280ede5287 tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2f92688c-8a0d-4ef2-9fa5-3a280ede5287 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-2f92688c-8a0d-4ef2-9fa5-3a280ede5287 tempest-CreateVolumesFromImageTest-1417329816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:10 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-2f92688c-8a0d-4ef2-9fa5-3a280ede5287 tempest-CreateVolumesFromImageTest-1417329816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2f92688c-8a0d-4ef2-9fa5-3a280ede5287 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2f92688c-8a0d-4ef2-9fa5-3a280ede5287 tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:10 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:10 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:10 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-178da9c5-5966-4919-9a7f-65bc6b8de982 tempest-VolumeDependencyTests-1493625113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf" returned: 0 in 0.585s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:10 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-178da9c5-5966-4919-9a7f-65bc6b8de982 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.e76e83fb-efd6-48e5-8a16-cc76b6f2c44f 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:10 devstack sudo[90192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.e76e83fb-efd6-48e5-8a16-cc76b6f2c44f 1G Apr 21 21:01:10 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:11 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2f92688c-8a0d-4ef2-9fa5-3a280ede5287 tempest-CreateVolumesFromImageTest-1417329816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.506s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-2f92688c-8a0d-4ef2-9fa5-3a280ede5287 tempest-CreateVolumesFromImageTest-1417329816 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:11 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-2f92688c-8a0d-4ef2-9fa5-3a280ede5287 tempest-CreateVolumesFromImageTest-1417329816 None] Deleted volume successfully. Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-2f92688c-8a0d-4ef2-9fa5-3a280ede5287 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "cinder-5c4b35ea-a4a3-480d-a0e6-1ce7d58bb5c1-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Flow 'volume_create_manager' (2d47c929-a81a-466e-beb1-49ee0ba281f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29fb349e-7413-4a95-9570-d202a0b534cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29fb349e-7413-4a95-9570-d202a0b534cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1633283190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23456be6-9408-4b8e-be96-1e4855066929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772bfc67b6064a3b8c2ca66371ab1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:11Z,use_quota=True,user_id='88979408a2334af0adcd2600b4f78ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6651ef-7075-43d0-ae50-b6ca07970a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6651ef-7075-43d0-ae50-b6ca07970a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40dc2766-e96d-4a50-98fa-c4704cf1d0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40dc2766-e96d-4a50-98fa-c4704cf1d0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23456be6-9408-4b8e-be96-1e4855066929', 'volume_name': 'volume-23456be6-9408-4b8e-be96-1e4855066929', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6670a38a-9916-4dee-bda7-a3a441e06878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6670a38a-9916-4dee-bda7-a3a441e06878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b373419-68dd-4c11-b84d-438c1c7460eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:11 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Volume 23456be6-9408-4b8e-be96-1e4855066929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23456be6-9408-4b8e-be96-1e4855066929', 'volume_size': 1} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:11 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Flow 'volume_create_manager' (8ef04905-07a0-4bec-bdce-b49e45d4a34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7345655d-156e-4302-8c25-387421d0c0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7345655d-156e-4302-8c25-387421d0c0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-523436165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd00922f-873e-471c-a07e-557407bc60bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772bfc67b6064a3b8c2ca66371ab1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:12Z,use_quota=True,user_id='88979408a2334af0adcd2600b4f78ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a5e057-e5d7-4e0c-95b4-62efe3669cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a5e057-e5d7-4e0c-95b4-62efe3669cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e350d06-4bf5-4ef9-832c-c61e93b1eb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e350d06-4bf5-4ef9-832c-c61e93b1eb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd00922f-873e-471c-a07e-557407bc60bc', 'volume_name': 'volume-cd00922f-873e-471c-a07e-557407bc60bc', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc38892-0015-4b88-891d-53de644c0dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc38892-0015-4b88-891d-53de644c0dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f41b649-9f0a-4ab1-a131-6eb0f2f91a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:11 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Volume cd00922f-873e-471c-a07e-557407bc60bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd00922f-873e-471c-a07e-557407bc60bc', 'volume_size': 1} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-93b12c5a-1eb2-4869-97b3-e7ebf75ccff3 tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "cinder-f70da106-f2a1-422f-8ed3-0f00140e16da-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-178da9c5-5966-4919-9a7f-65bc6b8de982 tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.e76e83fb-efd6-48e5-8a16-cc76b6f2c44f 1G" returned: 0 in 0.920s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-178da9c5-5966-4919-9a7f-65bc6b8de982 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.e76e83fb-efd6-48e5-8a16-cc76b6f2c44f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-93b12c5a-1eb2-4869-97b3-e7ebf75ccff3 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "cinder-f70da106-f2a1-422f-8ed3-0f00140e16da-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:11 devstack sudo[90198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.e76e83fb-efd6-48e5-8a16-cc76b6f2c44f Apr 21 21:01:11 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-93b12c5a-1eb2-4869-97b3-e7ebf75ccff3 tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "cinder-quobyte-f70da106-f2a1-422f-8ed3-0f00140e16da" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-93b12c5a-1eb2-4869-97b3-e7ebf75ccff3 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "cinder-quobyte-f70da106-f2a1-422f-8ed3-0f00140e16da" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b41468-af96-452a-a62f-403e5b2a6a1d]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-93b12c5a-1eb2-4869-97b3-e7ebf75ccff3 tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f70da106-f2a1-422f-8ed3-0f00140e16da {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Flow 'volume_create_manager' (052a7577-f225-4261-b1ed-551b884f0e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e241d9-f329-470b-a634-eba130c39aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:11 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e241d9-f329-470b-a634-eba130c39aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1630785083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab860c1c-acdf-4f5a-8de0-51960f46834a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772bfc67b6064a3b8c2ca66371ab1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:12Z,use_quota=True,user_id='88979408a2334af0adcd2600b4f78ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:11 devstack sudo[90200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f70da106-f2a1-422f-8ed3-0f00140e16da Apr 21 21:01:11 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c08d862-cce7-4e0e-9bcf-c2fdfef95849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c08d862-cce7-4e0e-9bcf-c2fdfef95849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b69d717-76fa-4bf8-8354-72f2e8d71d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b69d717-76fa-4bf8-8354-72f2e8d71d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab860c1c-acdf-4f5a-8de0-51960f46834a', 'volume_name': 'volume-ab860c1c-acdf-4f5a-8de0-51960f46834a', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f492ba3-0a09-4365-91c2-29585c68ff47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f492ba3-0a09-4365-91c2-29585c68ff47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984a5fb9-6388-4eba-a1dc-e1be597c02e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:12 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Volume ab860c1c-acdf-4f5a-8de0-51960f46834a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab860c1c-acdf-4f5a-8de0-51960f46834a', 'volume_size': 1} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Flow 'volume_create_manager' (539cffdf-af99-4437-b35e-49b77d40980f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0383ce46-3b56-4f00-ac25-a94ec51a5e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0383ce46-3b56-4f00-ac25-a94ec51a5e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1977793619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d6a78d4-7136-41fe-95d5-8487a6565b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772bfc67b6064a3b8c2ca66371ab1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:12Z,use_quota=True,user_id='88979408a2334af0adcd2600b4f78ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27c8685-12ce-4faf-bee8-ba8bbdd38640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27c8685-12ce-4faf-bee8-ba8bbdd38640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410382a5-8234-49c1-9aa3-cd5831badf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410382a5-8234-49c1-9aa3-cd5831badf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d6a78d4-7136-41fe-95d5-8487a6565b75', 'volume_name': 'volume-2d6a78d4-7136-41fe-95d5-8487a6565b75', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a5bd26-6d50-4d25-ba6f-2200f61ca2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a5bd26-6d50-4d25-ba6f-2200f61ca2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d97ecb-2c8b-484e-b123-453e34984bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:12 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Volume 2d6a78d4-7136-41fe-95d5-8487a6565b75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d6a78d4-7136-41fe-95d5-8487a6565b75', 'volume_size': 1} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Flow 'volume_create_manager' (92ba0fb4-d90e-480b-8201-67eae7bcd24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5cb51e-60e8-4038-b0c7-72c24554ce06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:12 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5cb51e-60e8-4038-b0c7-72c24554ce06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1568684901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2dd41b2-d512-4eac-af6a-4b0b92da393e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772bfc67b6064a3b8c2ca66371ab1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:12Z,use_quota=True,user_id='88979408a2334af0adcd2600b4f78ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ba29e5-3f9e-4a4c-992c-ce9ffc3221d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:12 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ba29e5-3f9e-4a4c-992c-ce9ffc3221d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5fea22a-c5e1-40ab-9e91-8da6a9910651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5fea22a-c5e1-40ab-9e91-8da6a9910651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2dd41b2-d512-4eac-af6a-4b0b92da393e', 'volume_name': 'volume-a2dd41b2-d512-4eac-af6a-4b0b92da393e', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e8a4f6-9f81-4090-b04e-67f2b1206d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e8a4f6-9f81-4090-b04e-67f2b1206d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8617aeb-945e-4b28-b819-a65dbcef4149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:12 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Volume a2dd41b2-d512-4eac-af6a-4b0b92da393e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2dd41b2-d512-4eac-af6a-4b0b92da393e', 'volume_size': 1} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-93b12c5a-1eb2-4869-97b3-e7ebf75ccff3 tempest-CreateVolumesFromImageTest-1417329816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f70da106-f2a1-422f-8ed3-0f00140e16da" returned: 0 in 0.714s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-93b12c5a-1eb2-4869-97b3-e7ebf75ccff3 tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f70da106-f2a1-422f-8ed3-0f00140e16da {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-178da9c5-5966-4919-9a7f-65bc6b8de982 tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.e76e83fb-efd6-48e5-8a16-cc76b6f2c44f" returned: 0 in 0.799s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:12 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-178da9c5-5966-4919-9a7f-65bc6b8de982 tempest-VolumeDependencyTests-1493625113 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.e76e83fb-efd6-48e5-8a16-cc76b6f2c44f is being set with open permissions: ugo+rw Apr 21 21:01:12 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-178da9c5-5966-4919-9a7f-65bc6b8de982 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.e76e83fb-efd6-48e5-8a16-cc76b6f2c44f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:12 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f70da106-f2a1-422f-8ed3-0f00140e16da Apr 21 21:01:12 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:12 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.e76e83fb-efd6-48e5-8a16-cc76b6f2c44f Apr 21 21:01:12 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:13 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-93b12c5a-1eb2-4869-97b3-e7ebf75ccff3 tempest-CreateVolumesFromImageTest-1417329816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-f70da106-f2a1-422f-8ed3-0f00140e16da" returned: 0 in 0.528s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-93b12c5a-1eb2-4869-97b3-e7ebf75ccff3 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "cinder-quobyte-f70da106-f2a1-422f-8ed3-0f00140e16da" released by "delete_volume" :: held 1.274s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-93b12c5a-1eb2-4869-97b3-e7ebf75ccff3 tempest-CreateVolumesFromImageTest-1417329816 None] Created reservations ['46b010e7-8708-4ed5-b3d7-61b6fd978e44', '2bd7bc29-9431-4e24-9dc2-c067f9236ba9', '1168cb15-61cf-45a5-99d8-fc2fb0861121', '9a21be31-4f0f-4bb9-ac28-5d33a444f2db'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-93b12c5a-1eb2-4869-97b3-e7ebf75ccff3 tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-93b12c5a-1eb2-4869-97b3-e7ebf75ccff3 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-93b12c5a-1eb2-4869-97b3-e7ebf75ccff3 tempest-CreateVolumesFromImageTest-1417329816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-93b12c5a-1eb2-4869-97b3-e7ebf75ccff3 tempest-CreateVolumesFromImageTest-1417329816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-93b12c5a-1eb2-4869-97b3-e7ebf75ccff3 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-93b12c5a-1eb2-4869-97b3-e7ebf75ccff3 tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:13 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-178da9c5-5966-4919-9a7f-65bc6b8de982 tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.e76e83fb-efd6-48e5-8a16-cc76b6f2c44f" returned: 0 in 0.639s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:13 devstack sudo[90214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:13 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-178da9c5-5966-4919-9a7f-65bc6b8de982 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:13 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.info Apr 21 21:01:13 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Flow 'volume_create_manager' (21c8c171-faa7-4e32-9c8a-deca98d2d7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f9b213c-fa75-435b-94e9-ca2075195fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f9b213c-fa75-435b-94e9-ca2075195fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-856020443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa21df73-27b0-4824-892a-143749024acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f83f5046069e45dcba0cf934080963d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:13Z,use_quota=True,user_id='ec6350e1a3254001997c6caa0b2939af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a37b37d-8cdb-472e-8ff3-2f38f2b2cf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a37b37d-8cdb-472e-8ff3-2f38f2b2cf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdfc9a7e-5c36-485c-b7a7-2936865ebbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdfc9a7e-5c36-485c-b7a7-2936865ebbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa21df73-27b0-4824-892a-143749024acd', 'volume_name': 'volume-aa21df73-27b0-4824-892a-143749024acd', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03cc60f8-38b0-4d81-a7d1-318c83eab8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03cc60f8-38b0-4d81-a7d1-318c83eab8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d94aabe-3b6e-477d-ac2f-1b8d03603d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:13 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Volume aa21df73-27b0-4824-892a-143749024acd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa21df73-27b0-4824-892a-143749024acd', 'volume_size': 1} Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:13 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-93b12c5a-1eb2-4869-97b3-e7ebf75ccff3 tempest-CreateVolumesFromImageTest-1417329816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.518s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-93b12c5a-1eb2-4869-97b3-e7ebf75ccff3 tempest-CreateVolumesFromImageTest-1417329816 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:13 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-93b12c5a-1eb2-4869-97b3-e7ebf75ccff3 tempest-CreateVolumesFromImageTest-1417329816 None] Deleted volume successfully. Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-93b12c5a-1eb2-4869-97b3-e7ebf75ccff3 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "cinder-f70da106-f2a1-422f-8ed3-0f00140e16da-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:13 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-178da9c5-5966-4919-9a7f-65bc6b8de982 tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.info" returned: 0 in 0.539s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:13 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-178da9c5-5966-4919-9a7f-65bc6b8de982 tempest-VolumeDependencyTests-1493625113 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.info is being set with open permissions: ugo+rw Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-178da9c5-5966-4919-9a7f-65bc6b8de982 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:13 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.info Apr 21 21:01:13 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f46547a6-8bf4-4374-9c45-57fa47690f67 tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "cinder-64301e98-49ab-4d99-872b-dddc4e7bb665-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:13 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f46547a6-8bf4-4374-9c45-57fa47690f67 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "cinder-64301e98-49ab-4d99-872b-dddc4e7bb665-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:14 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f46547a6-8bf4-4374-9c45-57fa47690f67 tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "cinder-quobyte-64301e98-49ab-4d99-872b-dddc4e7bb665" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:14 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f46547a6-8bf4-4374-9c45-57fa47690f67 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "cinder-quobyte-64301e98-49ab-4d99-872b-dddc4e7bb665" acquired by "delete_volume" :: waited 0.017s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:14 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea75f7f8-1eb5-480f-a7c3-dc2199591e61]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f46547a6-8bf4-4374-9c45-57fa47690f67 tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-64301e98-49ab-4d99-872b-dddc4e7bb665 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:14 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-64301e98-49ab-4d99-872b-dddc4e7bb665 Apr 21 21:01:14 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:14 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-178da9c5-5966-4919-9a7f-65bc6b8de982 tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.info" returned: 0 in 0.420s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-178da9c5-5966-4919-9a7f-65bc6b8de982 tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.976s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.599s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:14 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1633283190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23456be6-9408-4b8e-be96-1e4855066929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772bfc67b6064a3b8c2ca66371ab1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:11Z,use_quota=True,user_id='88979408a2334af0adcd2600b4f78ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:14 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Creating volume 23456be6-9408-4b8e-be96-1e4855066929 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:14 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:14 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:14 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:14 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:01:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-23456be6-9408-4b8e-be96-1e4855066929 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:14 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-178da9c5-5966-4919-9a7f-65bc6b8de982 tempest-VolumeDependencyTests-1493625113 None] Create snapshot completed successfully Apr 21 21:01:14 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-23456be6-9408-4b8e-be96-1e4855066929 1073741824 Apr 21 21:01:14 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:14 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f46547a6-8bf4-4374-9c45-57fa47690f67 tempest-CreateVolumesFromImageTest-1417329816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-64301e98-49ab-4d99-872b-dddc4e7bb665" returned: 0 in 0.518s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f46547a6-8bf4-4374-9c45-57fa47690f67 tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-64301e98-49ab-4d99-872b-dddc4e7bb665 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:14 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-64301e98-49ab-4d99-872b-dddc4e7bb665 Apr 21 21:01:14 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:14 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-23456be6-9408-4b8e-be96-1e4855066929 1073741824" returned: 0 in 0.537s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-23456be6-9408-4b8e-be96-1e4855066929 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:14 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-23456be6-9408-4b8e-be96-1e4855066929 Apr 21 21:01:14 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:14 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:14 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f46547a6-8bf4-4374-9c45-57fa47690f67 tempest-CreateVolumesFromImageTest-1417329816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-64301e98-49ab-4d99-872b-dddc4e7bb665" returned: 0 in 0.427s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:14 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f46547a6-8bf4-4374-9c45-57fa47690f67 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "cinder-quobyte-64301e98-49ab-4d99-872b-dddc4e7bb665" released by "delete_volume" :: held 0.966s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-f46547a6-8bf4-4374-9c45-57fa47690f67 tempest-CreateVolumesFromImageTest-1417329816 None] Created reservations ['aca0b1a9-60fc-4c3b-9a40-f9acb06cc898', 'f976a80a-729c-488c-9185-f5a3d71d607a', '86147540-7023-4aa3-b63e-58ea8d7d5ae6', 'e5b28beb-66a7-41ca-8202-9cf2d0e06720'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f46547a6-8bf4-4374-9c45-57fa47690f67 tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f46547a6-8bf4-4374-9c45-57fa47690f67 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f46547a6-8bf4-4374-9c45-57fa47690f67 tempest-CreateVolumesFromImageTest-1417329816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f46547a6-8bf4-4374-9c45-57fa47690f67 tempest-CreateVolumesFromImageTest-1417329816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f46547a6-8bf4-4374-9c45-57fa47690f67 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f46547a6-8bf4-4374-9c45-57fa47690f67 tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:15 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:15 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7cd1e907-17a9-4903-bdf0-3d7735efe98a tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "cinder-9ed97013-c11d-46aa-b77f-8e8e7f483cdd-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7cd1e907-17a9-4903-bdf0-3d7735efe98a tempest-CreateVolumesFromImageTest-1417329816 None] Lock "cinder-9ed97013-c11d-46aa-b77f-8e8e7f483cdd-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7cd1e907-17a9-4903-bdf0-3d7735efe98a tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "cinder-quobyte-9ed97013-c11d-46aa-b77f-8e8e7f483cdd" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7cd1e907-17a9-4903-bdf0-3d7735efe98a tempest-CreateVolumesFromImageTest-1417329816 None] Lock "cinder-quobyte-9ed97013-c11d-46aa-b77f-8e8e7f483cdd" acquired by "delete_volume" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[78048921-ca0b-42ce-a43d-66fa197fed06]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7cd1e907-17a9-4903-bdf0-3d7735efe98a tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ed97013-c11d-46aa-b77f-8e8e7f483cdd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:15 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ed97013-c11d-46aa-b77f-8e8e7f483cdd Apr 21 21:01:15 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:15 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-23456be6-9408-4b8e-be96-1e4855066929" returned: 0 in 0.455s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.474s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-523436165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd00922f-873e-471c-a07e-557407bc60bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772bfc67b6064a3b8c2ca66371ab1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:12Z,use_quota=True,user_id='88979408a2334af0adcd2600b4f78ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Creating volume cd00922f-873e-471c-a07e-557407bc60bc {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:15 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-cd00922f-873e-471c-a07e-557407bc60bc 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b373419-68dd-4c11-b84d-438c1c7460eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23456be6-9408-4b8e-be96-1e4855066929', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:15 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-cd00922f-873e-471c-a07e-557407bc60bc 1073741824 Apr 21 21:01:15 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d35d39-d61e-4c5f-8651-61b01b3d15fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:15 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Volume volume-23456be6-9408-4b8e-be96-1e4855066929 (23456be6-9408-4b8e-be96-1e4855066929): created successfully Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d35d39-d61e-4c5f-8651-61b01b3d15fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Flow 'volume_create_manager' (2d47c929-a81a-466e-beb1-49ee0ba281f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:15 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-e83e089c-4b88-4f36-82aa-5696043e6049 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Created volume successfully. Apr 21 21:01:15 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f46547a6-8bf4-4374-9c45-57fa47690f67 tempest-CreateVolumesFromImageTest-1417329816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.432s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-f46547a6-8bf4-4374-9c45-57fa47690f67 tempest-CreateVolumesFromImageTest-1417329816 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:15 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-f46547a6-8bf4-4374-9c45-57fa47690f67 tempest-CreateVolumesFromImageTest-1417329816 None] Deleted volume successfully. Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f46547a6-8bf4-4374-9c45-57fa47690f67 tempest-CreateVolumesFromImageTest-1417329816 None] Lock "cinder-64301e98-49ab-4d99-872b-dddc4e7bb665-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Flow 'volume_create_manager' (3ab6121d-bed3-45da-9288-156963a2b95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b76f506-8128-4d78-8fee-b424319e5ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b76f506-8128-4d78-8fee-b424319e5ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1657045575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d805bda0-a8b8-4433-b9ae-5fe5cca2912d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='990e76bea3b5471b8ea4aeaa9c902fdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e76e83fb-efd6-48e5-8a16-cc76b6f2c44f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:16Z,use_quota=True,user_id='8088ea50ab7a444b872d62cf6f480937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2f0f23-9ded-430c-8f70-702e34a47957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2f0f23-9ded-430c-8f70-702e34a47957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c505ffb-6ffb-4cbb-9f81-63486b61d08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c505ffb-6ffb-4cbb-9f81-63486b61d08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd805bda0-a8b8-4433-b9ae-5fe5cca2912d', 'volume_name': 'volume-d805bda0-a8b8-4433-b9ae-5fe5cca2912d', 'volume_size': 1, 'snapshot_id': 'e76e83fb-efd6-48e5-8a16-cc76b6f2c44f'}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d0d200-58c3-4319-9c5a-9cf1d51dd4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d0d200-58c3-4319-9c5a-9cf1d51dd4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd2bfd2-0f5f-48ae-ade7-e4d9a04568dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:15 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Volume d805bda0-a8b8-4433-b9ae-5fe5cca2912d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d805bda0-a8b8-4433-b9ae-5fe5cca2912d', 'volume_size': 1, 'snapshot_id': 'e76e83fb-efd6-48e5-8a16-cc76b6f2c44f'} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:15 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7cd1e907-17a9-4903-bdf0-3d7735efe98a tempest-CreateVolumesFromImageTest-1417329816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ed97013-c11d-46aa-b77f-8e8e7f483cdd" returned: 0 in 0.601s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7cd1e907-17a9-4903-bdf0-3d7735efe98a tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ed97013-c11d-46aa-b77f-8e8e7f483cdd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:15 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ed97013-c11d-46aa-b77f-8e8e7f483cdd Apr 21 21:01:15 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:15 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-cd00922f-873e-471c-a07e-557407bc60bc 1073741824" returned: 0 in 0.541s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:15 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-cd00922f-873e-471c-a07e-557407bc60bc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:15 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-cd00922f-873e-471c-a07e-557407bc60bc Apr 21 21:01:15 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:16 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7cd1e907-17a9-4903-bdf0-3d7735efe98a tempest-CreateVolumesFromImageTest-1417329816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9ed97013-c11d-46aa-b77f-8e8e7f483cdd" returned: 0 in 0.398s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7cd1e907-17a9-4903-bdf0-3d7735efe98a tempest-CreateVolumesFromImageTest-1417329816 None] Lock "cinder-quobyte-9ed97013-c11d-46aa-b77f-8e8e7f483cdd" released by "delete_volume" :: held 1.020s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-7cd1e907-17a9-4903-bdf0-3d7735efe98a tempest-CreateVolumesFromImageTest-1417329816 None] Created reservations ['c57499ed-355c-43c9-b52e-2f020d2a72de', '2b7c1fbf-542a-4ddd-b2a1-c7c881018228', '363f6fda-5c69-4f8b-af99-082e25415760', 'f5f3e2d4-2cde-4f05-9d56-8e6770a3e350'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:16 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-cd00922f-873e-471c-a07e-557407bc60bc" returned: 0 in 0.401s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.238s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1630785083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab860c1c-acdf-4f5a-8de0-51960f46834a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772bfc67b6064a3b8c2ca66371ab1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:12Z,use_quota=True,user_id='88979408a2334af0adcd2600b4f78ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Creating volume ab860c1c-acdf-4f5a-8de0-51960f46834a {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:16 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab860c1c-acdf-4f5a-8de0-51960f46834a 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:16 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab860c1c-acdf-4f5a-8de0-51960f46834a 1073741824 Apr 21 21:01:16 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f41b649-9f0a-4ab1-a131-6eb0f2f91a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd00922f-873e-471c-a07e-557407bc60bc', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434ab8ef-b4ba-42b4-af52-137243f1ea30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7cd1e907-17a9-4903-bdf0-3d7735efe98a tempest-CreateVolumesFromImageTest-1417329816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7cd1e907-17a9-4903-bdf0-3d7735efe98a tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7cd1e907-17a9-4903-bdf0-3d7735efe98a tempest-CreateVolumesFromImageTest-1417329816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7cd1e907-17a9-4903-bdf0-3d7735efe98a tempest-CreateVolumesFromImageTest-1417329816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7cd1e907-17a9-4903-bdf0-3d7735efe98a tempest-CreateVolumesFromImageTest-1417329816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7cd1e907-17a9-4903-bdf0-3d7735efe98a tempest-CreateVolumesFromImageTest-1417329816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:16 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Volume volume-cd00922f-873e-471c-a07e-557407bc60bc (cd00922f-873e-471c-a07e-557407bc60bc): created successfully Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434ab8ef-b4ba-42b4-af52-137243f1ea30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Flow 'volume_create_manager' (8ef04905-07a0-4bec-bdce-b49e45d4a34d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:16 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:16 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:16 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-afc62fbd-c8f1-4672-abd7-446645948a75 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Created volume successfully. Apr 21 21:01:16 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab860c1c-acdf-4f5a-8de0-51960f46834a 1073741824" returned: 0 in 0.494s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab860c1c-acdf-4f5a-8de0-51960f46834a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:16 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab860c1c-acdf-4f5a-8de0-51960f46834a Apr 21 21:01:16 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:16 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7cd1e907-17a9-4903-bdf0-3d7735efe98a tempest-CreateVolumesFromImageTest-1417329816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.484s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-7cd1e907-17a9-4903-bdf0-3d7735efe98a tempest-CreateVolumesFromImageTest-1417329816 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:16 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-7cd1e907-17a9-4903-bdf0-3d7735efe98a tempest-CreateVolumesFromImageTest-1417329816 None] Deleted volume successfully. Apr 21 21:01:16 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-7cd1e907-17a9-4903-bdf0-3d7735efe98a tempest-CreateVolumesFromImageTest-1417329816 None] Lock "cinder-9ed97013-c11d-46aa-b77f-8e8e7f483cdd-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:17 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab860c1c-acdf-4f5a-8de0-51960f46834a" returned: 0 in 0.402s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:17 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.921s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:17 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1977793619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d6a78d4-7136-41fe-95d5-8487a6565b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772bfc67b6064a3b8c2ca66371ab1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:12Z,use_quota=True,user_id='88979408a2334af0adcd2600b4f78ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:17 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Creating volume 2d6a78d4-7136-41fe-95d5-8487a6565b75 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:17 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:17 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:17 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:17 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:01:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2d6a78d4-7136-41fe-95d5-8487a6565b75 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:17 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984a5fb9-6388-4eba-a1dc-e1be597c02e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab860c1c-acdf-4f5a-8de0-51960f46834a', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:17 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2d6a78d4-7136-41fe-95d5-8487a6565b75 1073741824 Apr 21 21:01:17 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:17 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291fdf5a-d211-4a59-b1db-83dc53c949aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:17 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Volume volume-ab860c1c-acdf-4f5a-8de0-51960f46834a (ab860c1c-acdf-4f5a-8de0-51960f46834a): created successfully Apr 21 21:01:17 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291fdf5a-d211-4a59-b1db-83dc53c949aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:17 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Flow 'volume_create_manager' (052a7577-f225-4261-b1ed-551b884f0e3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:17 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-989f0259-8b4c-4b08-aae1-b553af086bae tempest-CreateVolumesFromSnapshotTest-1221784384 None] Created volume successfully. Apr 21 21:01:17 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2d6a78d4-7136-41fe-95d5-8487a6565b75 1073741824" returned: 0 in 0.550s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:17 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2d6a78d4-7136-41fe-95d5-8487a6565b75 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:17 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2d6a78d4-7136-41fe-95d5-8487a6565b75 Apr 21 21:01:17 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:18 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2d6a78d4-7136-41fe-95d5-8487a6565b75" returned: 0 in 0.467s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.642s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1568684901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2dd41b2-d512-4eac-af6a-4b0b92da393e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772bfc67b6064a3b8c2ca66371ab1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:12Z,use_quota=True,user_id='88979408a2334af0adcd2600b4f78ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Creating volume a2dd41b2-d512-4eac-af6a-4b0b92da393e {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:18 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a2dd41b2-d512-4eac-af6a-4b0b92da393e 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d97ecb-2c8b-484e-b123-453e34984bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d6a78d4-7136-41fe-95d5-8487a6565b75', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c14f08bc-9ea1-4a68-ac25-90fab0551d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:18 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a2dd41b2-d512-4eac-af6a-4b0b92da393e 1073741824 Apr 21 21:01:18 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:18 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Volume volume-2d6a78d4-7136-41fe-95d5-8487a6565b75 (2d6a78d4-7136-41fe-95d5-8487a6565b75): created successfully Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c14f08bc-9ea1-4a68-ac25-90fab0551d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Flow 'volume_create_manager' (539cffdf-af99-4437-b35e-49b77d40980f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:18 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-90c15525-52cc-4dfa-ae68-e0824c1685f8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Created volume successfully. Apr 21 21:01:18 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a2dd41b2-d512-4eac-af6a-4b0b92da393e 1073741824" returned: 0 in 0.529s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a2dd41b2-d512-4eac-af6a-4b0b92da393e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:18 devstack sudo[90282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a2dd41b2-d512-4eac-af6a-4b0b92da393e Apr 21 21:01:18 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Flow 'volume_create_manager' (a162c0af-706e-4317-b891-681a84c422e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb46ffbc-790a-44d0-9ebd-6c1207feb0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb46ffbc-790a-44d0-9ebd-6c1207feb0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-480094633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f3f4361-73a8-4a80-beac-b4051d6c6ed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346e52fb33b642f09beb70cd3bd303dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:19Z,use_quota=True,user_id='d86e0664e847453b820999cbb20033b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f90258-22ea-4b04-8908-a9a40c81be9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f90258-22ea-4b04-8908-a9a40c81be9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188065ea-9a5c-4424-bd90-06bfa3c1cc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188065ea-9a5c-4424-bd90-06bfa3c1cc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f3f4361-73a8-4a80-beac-b4051d6c6ed9', 'volume_name': 'volume-8f3f4361-73a8-4a80-beac-b4051d6c6ed9', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b71b7616-c188-496f-a0a9-873e78f7ccee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b71b7616-c188-496f-a0a9-873e78f7ccee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ad4d1e-1eef-4ced-954b-d86f3f011e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:18 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Volume 8f3f4361-73a8-4a80-beac-b4051d6c6ed9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f3f4361-73a8-4a80-beac-b4051d6c6ed9', 'volume_size': 1} Apr 21 21:01:18 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:19 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a2dd41b2-d512-4eac-af6a-4b0b92da393e" returned: 0 in 0.430s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.652s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-856020443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa21df73-27b0-4824-892a-143749024acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f83f5046069e45dcba0cf934080963d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:13Z,use_quota=True,user_id='ec6350e1a3254001997c6caa0b2939af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Creating volume aa21df73-27b0-4824-892a-143749024acd {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:19 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:19 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:01:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:19 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8617aeb-945e-4b28-b819-a65dbcef4149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2dd41b2-d512-4eac-af6a-4b0b92da393e', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:19 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c52f4dd-a0cf-4be2-afa6-d153ceccb64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:19 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd 1073741824 Apr 21 21:01:19 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:19 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Volume volume-a2dd41b2-d512-4eac-af6a-4b0b92da393e (a2dd41b2-d512-4eac-af6a-4b0b92da393e): created successfully Apr 21 21:01:19 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c52f4dd-a0cf-4be2-afa6-d153ceccb64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:19 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Flow 'volume_create_manager' (92ba0fb4-d90e-480b-8201-67eae7bcd24b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:19 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-711d2843-6c21-4ca7-ae76-efba7cb70126 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Created volume successfully. Apr 21 21:01:19 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd 1073741824" returned: 0 in 0.470s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:19 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:19 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd Apr 21 21:01:19 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f34f82ac-c55e-4367-9a1c-89b1eddb75b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "cinder-a2dd41b2-d512-4eac-af6a-4b0b92da393e-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f34f82ac-c55e-4367-9a1c-89b1eddb75b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-a2dd41b2-d512-4eac-af6a-4b0b92da393e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f34f82ac-c55e-4367-9a1c-89b1eddb75b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "cinder-quobyte-a2dd41b2-d512-4eac-af6a-4b0b92da393e" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f34f82ac-c55e-4367-9a1c-89b1eddb75b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-quobyte-a2dd41b2-d512-4eac-af6a-4b0b92da393e" acquired by "delete_volume" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ef5760-ae6b-487a-bc9d-2b271368f416]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f34f82ac-c55e-4367-9a1c-89b1eddb75b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a2dd41b2-d512-4eac-af6a-4b0b92da393e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:20 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd" returned: 0 in 0.486s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.424s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "cinder-quobyte-e76e83fb-efd6-48e5-8a16-cc76b6f2c44f-d805bda0-a8b8-4433-b9ae-5fe5cca2912d" by "_create_volume_from_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:20 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a2dd41b2-d512-4eac-af6a-4b0b92da393e Apr 21 21:01:20 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d94aabe-3b6e-477d-ac2f-1b8d03603d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa21df73-27b0-4824-892a-143749024acd', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042be96f-ba5e-4f25-8905-605ce35bfa36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-quobyte-e76e83fb-efd6-48e5-8a16-cc76b6f2c44f-d805bda0-a8b8-4433-b9ae-5fe5cca2912d" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Creating volume d805bda0-a8b8-4433-b9ae-5fe5cca2912d from snapshot e76e83fb-efd6-48e5-8a16-cc76b6f2c44f {{(pid=81957) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "cinder-quobyte-d805bda0-a8b8-4433-b9ae-5fe5cca2912d" by "_copy_volume_from_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:20 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Volume volume-aa21df73-27b0-4824-892a-143749024acd (aa21df73-27b0-4824-892a-143749024acd): created successfully Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042be96f-ba5e-4f25-8905-605ce35bfa36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Flow 'volume_create_manager' (21c8c171-faa7-4e32-9c8a-deca98d2d7c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:20 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-eb406808-7cc6-498c-a37c-36dfb40ea0a7 tempest-SnapshotDependencyTests-198707550 None] Created volume successfully. Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-quobyte-d805bda0-a8b8-4433-b9ae-5fe5cca2912d" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] snapshot: e76e83fb-efd6-48e5-8a16-cc76b6f2c44f, volume: d805bda0-a8b8-4433-b9ae-5fe5cca2912d, {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[578e8360-c7a6-4d62-a1e1-c1bba5742ffa]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.e76e83fb-efd6-48e5-8a16-cc76b6f2c44f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:20 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.e76e83fb-efd6-48e5-8a16-cc76b6f2c44f Apr 21 21:01:20 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:20 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f34f82ac-c55e-4367-9a1c-89b1eddb75b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a2dd41b2-d512-4eac-af6a-4b0b92da393e" returned: 0 in 0.471s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f34f82ac-c55e-4367-9a1c-89b1eddb75b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a2dd41b2-d512-4eac-af6a-4b0b92da393e {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:20 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a2dd41b2-d512-4eac-af6a-4b0b92da393e Apr 21 21:01:20 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:20 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.e76e83fb-efd6-48e5-8a16-cc76b6f2c44f" returned: 0 in 0.467s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Creating direct copy from snapshot {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65e65df-479f-418d-a8ca-632adcb0a63f]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:20 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:20 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf Apr 21 21:01:20 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:21 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f34f82ac-c55e-4367-9a1c-89b1eddb75b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a2dd41b2-d512-4eac-af6a-4b0b92da393e" returned: 0 in 0.451s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f34f82ac-c55e-4367-9a1c-89b1eddb75b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-quobyte-a2dd41b2-d512-4eac-af6a-4b0b92da393e" released by "delete_volume" :: held 0.957s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fc23b98e-e4c5-487d-80e1-c342936f22df tempest-SnapshotDependencyTests-198707550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-f34f82ac-c55e-4367-9a1c-89b1eddb75b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Created reservations ['0260984d-73fc-402d-94dd-0469567ccf6d', 'ef2d2b73-d9ba-4f23-a102-9b1d101eecb6', '044005ae-8c19-46c3-a80d-4eb99bec6c42', '6102e0eb-04c8-43a2-baf8-318d19f7d856'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f34f82ac-c55e-4367-9a1c-89b1eddb75b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f34f82ac-c55e-4367-9a1c-89b1eddb75b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f34f82ac-c55e-4367-9a1c-89b1eddb75b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f34f82ac-c55e-4367-9a1c-89b1eddb75b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f34f82ac-c55e-4367-9a1c-89b1eddb75b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f34f82ac-c55e-4367-9a1c-89b1eddb75b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:21 devstack sudo[90311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:21 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8304738d-9a90-436f-86f0-ad98317cace8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "cinder-2d6a78d4-7136-41fe-95d5-8487a6565b75-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8304738d-9a90-436f-86f0-ad98317cace8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-2d6a78d4-7136-41fe-95d5-8487a6565b75-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8304738d-9a90-436f-86f0-ad98317cace8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "cinder-quobyte-2d6a78d4-7136-41fe-95d5-8487a6565b75" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8304738d-9a90-436f-86f0-ad98317cace8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-quobyte-2d6a78d4-7136-41fe-95d5-8487a6565b75" acquired by "delete_volume" :: waited 0.006s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f08a1e-e499-445a-8934-eb83360f0eda]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8304738d-9a90-436f-86f0-ad98317cace8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2d6a78d4-7136-41fe-95d5-8487a6565b75 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:21 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf" returned: 0 in 0.545s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG cinder.utils [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Path /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d805bda0-a8b8-4433-b9ae-5fe5cca2912d not found in is_blk_device check {{(pid=81957) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d805bda0-a8b8-4433-b9ae-5fe5cca2912d {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:21 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d805bda0-a8b8-4433-b9ae-5fe5cca2912d Apr 21 21:01:21 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:21 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2d6a78d4-7136-41fe-95d5-8487a6565b75 Apr 21 21:01:21 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:21 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f34f82ac-c55e-4367-9a1c-89b1eddb75b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.420s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-f34f82ac-c55e-4367-9a1c-89b1eddb75b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:21 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-f34f82ac-c55e-4367-9a1c-89b1eddb75b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Deleted volume successfully. Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f34f82ac-c55e-4367-9a1c-89b1eddb75b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-a2dd41b2-d512-4eac-af6a-4b0b92da393e-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:21 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8304738d-9a90-436f-86f0-ad98317cace8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2d6a78d4-7136-41fe-95d5-8487a6565b75" returned: 0 in 0.575s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:21 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8304738d-9a90-436f-86f0-ad98317cace8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2d6a78d4-7136-41fe-95d5-8487a6565b75 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:21 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2d6a78d4-7136-41fe-95d5-8487a6565b75 Apr 21 21:01:21 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:22 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8304738d-9a90-436f-86f0-ad98317cace8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2d6a78d4-7136-41fe-95d5-8487a6565b75" returned: 0 in 0.710s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:22 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8304738d-9a90-436f-86f0-ad98317cace8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-quobyte-2d6a78d4-7136-41fe-95d5-8487a6565b75" released by "delete_volume" :: held 1.321s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:22 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-8304738d-9a90-436f-86f0-ad98317cace8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Created reservations ['83e9314b-1656-4c7c-aa37-1e0d39ae4d77', 'd6a93ec5-8cce-459d-b2c7-7528c9081c7e', 'b06ba1e2-17a4-48fe-95e9-dd00c88e9a7e', 'e33ba962-2575-4a18-aa41-2923874606d2'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8304738d-9a90-436f-86f0-ad98317cace8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8304738d-9a90-436f-86f0-ad98317cace8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:22 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8304738d-9a90-436f-86f0-ad98317cace8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:22 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-8304738d-9a90-436f-86f0-ad98317cace8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8304738d-9a90-436f-86f0-ad98317cace8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:22 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8304738d-9a90-436f-86f0-ad98317cace8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:22 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:22 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:23 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d805bda0-a8b8-4433-b9ae-5fe5cca2912d" returned: 0 in 1.950s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:23 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dace188-2e74-4db6-9dba-f21725e2110d]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:23 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf Apr 21 21:01:23 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:23 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6b232d6f-3688-4c76-847a-7bbcee10eed6 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "cinder-ab860c1c-acdf-4f5a-8de0-51960f46834a-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:23 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6b232d6f-3688-4c76-847a-7bbcee10eed6 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-ab860c1c-acdf-4f5a-8de0-51960f46834a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:23 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6b232d6f-3688-4c76-847a-7bbcee10eed6 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "cinder-quobyte-ab860c1c-acdf-4f5a-8de0-51960f46834a" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:23 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6b232d6f-3688-4c76-847a-7bbcee10eed6 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-quobyte-ab860c1c-acdf-4f5a-8de0-51960f46834a" acquired by "delete_volume" :: waited 0.018s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:23 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a6724e-d6d7-4f7c-940b-66422bab9862]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6b232d6f-3688-4c76-847a-7bbcee10eed6 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab860c1c-acdf-4f5a-8de0-51960f46834a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:23 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8304738d-9a90-436f-86f0-ad98317cace8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.725s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:23 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-8304738d-9a90-436f-86f0-ad98317cace8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:23 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-8304738d-9a90-436f-86f0-ad98317cace8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Deleted volume successfully. Apr 21 21:01:23 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab860c1c-acdf-4f5a-8de0-51960f46834a Apr 21 21:01:23 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:23 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8304738d-9a90-436f-86f0-ad98317cace8 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-2d6a78d4-7136-41fe-95d5-8487a6565b75-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:23 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf" returned: 0 in 0.565s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:23 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf, size 1024.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d805bda0-a8b8-4433-b9ae-5fe5cca2912d {{(pid=81957) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 21:01:23 devstack cinder-volume[81957]: INFO cinder.image.image_utils [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Converted 1024.00 MB image at 524.78 MB/s Apr 21 21:01:23 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d805bda0-a8b8-4433-b9ae-5fe5cca2912d is being set with open permissions: ugo+rw Apr 21 21:01:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d805bda0-a8b8-4433-b9ae-5fe5cca2912d {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:23 devstack sudo[90347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d805bda0-a8b8-4433-b9ae-5fe5cca2912d Apr 21 21:01:23 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:23 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6b232d6f-3688-4c76-847a-7bbcee10eed6 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab860c1c-acdf-4f5a-8de0-51960f46834a" returned: 0 in 0.470s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:23 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6b232d6f-3688-4c76-847a-7bbcee10eed6 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab860c1c-acdf-4f5a-8de0-51960f46834a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:23 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab860c1c-acdf-4f5a-8de0-51960f46834a Apr 21 21:01:23 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:24 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d805bda0-a8b8-4433-b9ae-5fe5cca2912d" returned: 0 in 0.416s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-quobyte-d805bda0-a8b8-4433-b9ae-5fe5cca2912d" released by "_copy_volume_from_snapshot" :: held 4.007s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-quobyte-e76e83fb-efd6-48e5-8a16-cc76b6f2c44f-d805bda0-a8b8-4433-b9ae-5fe5cca2912d" released by "_create_volume_from_snapshot" :: held 4.035s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.055s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.311s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-480094633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f3f4361-73a8-4a80-beac-b4051d6c6ed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346e52fb33b642f09beb70cd3bd303dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:19Z,use_quota=True,user_id='d86e0664e847453b820999cbb20033b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Creating volume 8f3f4361-73a8-4a80-beac-b4051d6c6ed9 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:24 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8f3f4361-73a8-4a80-beac-b4051d6c6ed9 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:24 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8f3f4361-73a8-4a80-beac-b4051d6c6ed9 1073741824 Apr 21 21:01:24 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd2bfd2-0f5f-48ae-ade7-e4d9a04568dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d805bda0-a8b8-4433-b9ae-5fe5cca2912d', 'volume_size': 1, 'snapshot_id': 'e76e83fb-efd6-48e5-8a16-cc76b6f2c44f'}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79852cb4-cfb9-4594-b1a2-1661e1b99e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:24 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Volume volume-d805bda0-a8b8-4433-b9ae-5fe5cca2912d (d805bda0-a8b8-4433-b9ae-5fe5cca2912d): created successfully Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79852cb4-cfb9-4594-b1a2-1661e1b99e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Flow 'volume_create_manager' (3ab6121d-bed3-45da-9288-156963a2b95f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:24 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-8a863760-59c9-46e4-891c-7e69ddd846f8 tempest-VolumeDependencyTests-1493625113 None] Created volume successfully. Apr 21 21:01:24 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6b232d6f-3688-4c76-847a-7bbcee10eed6 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-ab860c1c-acdf-4f5a-8de0-51960f46834a" returned: 0 in 0.399s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6b232d6f-3688-4c76-847a-7bbcee10eed6 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-quobyte-ab860c1c-acdf-4f5a-8de0-51960f46834a" released by "delete_volume" :: held 0.888s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-6b232d6f-3688-4c76-847a-7bbcee10eed6 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Created reservations ['5fc60fdd-6891-4bb7-80ae-a9110cf33408', '0f804486-3839-4c5f-98de-f50884095ca8', 'fdf803fe-c22b-4ea2-b027-b73d41cbfc67', '4acdc021-9972-4623-b38d-13f892d765d4'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6b232d6f-3688-4c76-847a-7bbcee10eed6 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6b232d6f-3688-4c76-847a-7bbcee10eed6 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6b232d6f-3688-4c76-847a-7bbcee10eed6 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-6b232d6f-3688-4c76-847a-7bbcee10eed6 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-6b232d6f-3688-4c76-847a-7bbcee10eed6 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6b232d6f-3688-4c76-847a-7bbcee10eed6 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:24 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:24 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3dd64f9e-794d-4022-ab6d-1fc3e5eb76b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "cinder-cd00922f-873e-471c-a07e-557407bc60bc-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3dd64f9e-794d-4022-ab6d-1fc3e5eb76b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-cd00922f-873e-471c-a07e-557407bc60bc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3dd64f9e-794d-4022-ab6d-1fc3e5eb76b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "cinder-quobyte-cd00922f-873e-471c-a07e-557407bc60bc" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3dd64f9e-794d-4022-ab6d-1fc3e5eb76b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-quobyte-cd00922f-873e-471c-a07e-557407bc60bc" acquired by "delete_volume" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fed2608-b5d7-4c9b-a6b7-4e278c2fe565]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3dd64f9e-794d-4022-ab6d-1fc3e5eb76b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-cd00922f-873e-471c-a07e-557407bc60bc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:24 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-cd00922f-873e-471c-a07e-557407bc60bc Apr 21 21:01:24 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:24 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8f3f4361-73a8-4a80-beac-b4051d6c6ed9 1073741824" returned: 0 in 0.486s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8f3f4361-73a8-4a80-beac-b4051d6c6ed9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:24 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8f3f4361-73a8-4a80-beac-b4051d6c6ed9 Apr 21 21:01:24 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:24 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-6b232d6f-3688-4c76-847a-7bbcee10eed6 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.421s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-6b232d6f-3688-4c76-847a-7bbcee10eed6 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:24 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-6b232d6f-3688-4c76-847a-7bbcee10eed6 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Deleted volume successfully. Apr 21 21:01:24 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-6b232d6f-3688-4c76-847a-7bbcee10eed6 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-ab860c1c-acdf-4f5a-8de0-51960f46834a-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:25 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3dd64f9e-794d-4022-ab6d-1fc3e5eb76b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-cd00922f-873e-471c-a07e-557407bc60bc" returned: 0 in 0.532s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3dd64f9e-794d-4022-ab6d-1fc3e5eb76b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-cd00922f-873e-471c-a07e-557407bc60bc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:25 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-cd00922f-873e-471c-a07e-557407bc60bc Apr 21 21:01:25 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:25 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8f3f4361-73a8-4a80-beac-b4051d6c6ed9" returned: 0 in 0.400s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fc23b98e-e4c5-487d-80e1-c342936f22df tempest-SnapshotDependencyTests-198707550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.073s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ad4d1e-1eef-4ced-954b-d86f3f011e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f3f4361-73a8-4a80-beac-b4051d6c6ed9', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (214eff51-7b41-4f6d-9d05-74bedad38c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-fc23b98e-e4c5-487d-80e1-c342936f22df tempest-SnapshotDependencyTests-198707550 None] Creating offline snapshot 179fa9c3-f3cb-44f2-84c9-e54844205de0 of volume aa21df73-27b0-4824-892a-143749024acd {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:01:25 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Volume volume-8f3f4361-73a8-4a80-beac-b4051d6c6ed9 (8f3f4361-73a8-4a80-beac-b4051d6c6ed9): created successfully Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (214eff51-7b41-4f6d-9d05-74bedad38c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Flow 'volume_create_manager' (a162c0af-706e-4317-b891-681a84c422e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e824623-d1e8-4680-827d-8046fab30b6f]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fc23b98e-e4c5-487d-80e1-c342936f22df tempest-SnapshotDependencyTests-198707550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:25 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-e36078fa-f1c1-47d6-a7f8-ea42fa7552c2 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Created volume successfully. Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5a3bdf7-b86c-4243-89cd-b5a9b8215ed0 tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "cinder-e76e83fb-efd6-48e5-8a16-cc76b6f2c44f-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5a3bdf7-b86c-4243-89cd-b5a9b8215ed0 tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-e76e83fb-efd6-48e5-8a16-cc76b6f2c44f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5a3bdf7-b86c-4243-89cd-b5a9b8215ed0 tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "cinder-quobyte-0daaeb98-668d-4d83-8a42-03ed5e214ddf" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:25 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd Apr 21 21:01:25 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5a3bdf7-b86c-4243-89cd-b5a9b8215ed0 tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-quobyte-0daaeb98-668d-4d83-8a42-03ed5e214ddf" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5a3bdf7-b86c-4243-89cd-b5a9b8215ed0 tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "cinder-quobyte-e76e83fb-efd6-48e5-8a16-cc76b6f2c44f" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5a3bdf7-b86c-4243-89cd-b5a9b8215ed0 tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-quobyte-e76e83fb-efd6-48e5-8a16-cc76b6f2c44f" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-c5a3bdf7-b86c-4243-89cd-b5a9b8215ed0 tempest-VolumeDependencyTests-1493625113 None] Deleting offline snapshot e76e83fb-efd6-48e5-8a16-cc76b6f2c44f of volume 0daaeb98-668d-4d83-8a42-03ed5e214ddf {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-c5a3bdf7-b86c-4243-89cd-b5a9b8215ed0 tempest-VolumeDependencyTests-1493625113 None] snapshot_file for this snap is: volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.e76e83fb-efd6-48e5-8a16-cc76b6f2c44f {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c39d747-890e-4341-8fbe-4e7ba37fc2dd]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c5a3bdf7-b86c-4243-89cd-b5a9b8215ed0 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.e76e83fb-efd6-48e5-8a16-cc76b6f2c44f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:25 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.e76e83fb-efd6-48e5-8a16-cc76b6f2c44f Apr 21 21:01:25 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:25 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3dd64f9e-794d-4022-ab6d-1fc3e5eb76b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-cd00922f-873e-471c-a07e-557407bc60bc" returned: 0 in 0.420s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3dd64f9e-794d-4022-ab6d-1fc3e5eb76b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-quobyte-cd00922f-873e-471c-a07e-557407bc60bc" released by "delete_volume" :: held 0.973s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-3dd64f9e-794d-4022-ab6d-1fc3e5eb76b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Created reservations ['6a7101ee-9862-4097-938e-15f82846a15f', '2943261a-652e-42ea-b11d-c88198d8aab2', '2491d2a5-43d2-44a6-86f5-ca40f4f7bb51', '4a7eef75-8c56-4f30-8843-967461ce9de0'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3dd64f9e-794d-4022-ab6d-1fc3e5eb76b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3dd64f9e-794d-4022-ab6d-1fc3e5eb76b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3dd64f9e-794d-4022-ab6d-1fc3e5eb76b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-3dd64f9e-794d-4022-ab6d-1fc3e5eb76b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-3dd64f9e-794d-4022-ab6d-1fc3e5eb76b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3dd64f9e-794d-4022-ab6d-1fc3e5eb76b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:25 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:25 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c12f818f-c15c-4785-a19b-21ad346c89f7 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "cinder-23456be6-9408-4b8e-be96-1e4855066929-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c12f818f-c15c-4785-a19b-21ad346c89f7 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-23456be6-9408-4b8e-be96-1e4855066929-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c12f818f-c15c-4785-a19b-21ad346c89f7 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "cinder-quobyte-23456be6-9408-4b8e-be96-1e4855066929" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c12f818f-c15c-4785-a19b-21ad346c89f7 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-quobyte-23456be6-9408-4b8e-be96-1e4855066929" acquired by "delete_volume" :: waited 0.006s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4e8fa2-b7a2-414d-9804-15977f46f798]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c12f818f-c15c-4785-a19b-21ad346c89f7 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-23456be6-9408-4b8e-be96-1e4855066929 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:25 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fc23b98e-e4c5-487d-80e1-c342936f22df tempest-SnapshotDependencyTests-198707550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd" returned: 0 in 0.556s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fc23b98e-e4c5-487d-80e1-c342936f22df tempest-SnapshotDependencyTests-198707550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.179fa9c3-f3cb-44f2-84c9-e54844205de0 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:25 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.179fa9c3-f3cb-44f2-84c9-e54844205de0 1G Apr 21 21:01:25 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:25 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-23456be6-9408-4b8e-be96-1e4855066929 Apr 21 21:01:25 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:25 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c5a3bdf7-b86c-4243-89cd-b5a9b8215ed0 tempest-VolumeDependencyTests-1493625113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.e76e83fb-efd6-48e5-8a16-cc76b6f2c44f" returned: 0 in 0.527s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-c5a3bdf7-b86c-4243-89cd-b5a9b8215ed0 tempest-VolumeDependencyTests-1493625113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[7079b980-43b4-4e1c-8ca4-fd62fc20ffa3]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:25 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c5a3bdf7-b86c-4243-89cd-b5a9b8215ed0 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:25 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf Apr 21 21:01:25 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:26 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-3dd64f9e-794d-4022-ab6d-1fc3e5eb76b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.509s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-3dd64f9e-794d-4022-ab6d-1fc3e5eb76b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:26 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-3dd64f9e-794d-4022-ab6d-1fc3e5eb76b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Deleted volume successfully. Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-3dd64f9e-794d-4022-ab6d-1fc3e5eb76b1 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-cd00922f-873e-471c-a07e-557407bc60bc-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:26 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c12f818f-c15c-4785-a19b-21ad346c89f7 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-23456be6-9408-4b8e-be96-1e4855066929" returned: 0 in 0.488s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c12f818f-c15c-4785-a19b-21ad346c89f7 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-23456be6-9408-4b8e-be96-1e4855066929 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:26 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fc23b98e-e4c5-487d-80e1-c342936f22df tempest-SnapshotDependencyTests-198707550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.179fa9c3-f3cb-44f2-84c9-e54844205de0 1G" returned: 0 in 0.486s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fc23b98e-e4c5-487d-80e1-c342936f22df tempest-SnapshotDependencyTests-198707550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa21df73-27b0-4824-892a-143749024acd -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.179fa9c3-f3cb-44f2-84c9-e54844205de0 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:26 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-23456be6-9408-4b8e-be96-1e4855066929 Apr 21 21:01:26 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:26 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa21df73-27b0-4824-892a-143749024acd -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.179fa9c3-f3cb-44f2-84c9-e54844205de0 Apr 21 21:01:26 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:26 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c5a3bdf7-b86c-4243-89cd-b5a9b8215ed0 tempest-VolumeDependencyTests-1493625113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf" returned: 0 in 0.531s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c5a3bdf7-b86c-4243-89cd-b5a9b8215ed0 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.e76e83fb-efd6-48e5-8a16-cc76b6f2c44f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:26 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.e76e83fb-efd6-48e5-8a16-cc76b6f2c44f Apr 21 21:01:26 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Flow 'volume_create_manager' (b55302f0-4e88-4aec-be1f-6d0376542e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35fe88c-99f2-4c1c-a722-13e52ecd33b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:26 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35fe88c-99f2-4c1c-a722-13e52ecd33b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1984264690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6b5ac9-b903-4505-b6dc-018b8e14a1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346e52fb33b642f09beb70cd3bd303dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:27Z,use_quota=True,user_id='d86e0664e847453b820999cbb20033b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016f5dea-9c1f-497b-b6c6-1fee5ca8c781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016f5dea-9c1f-497b-b6c6-1fee5ca8c781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7866de34-a86d-49ea-a7f1-e0ded15c1034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7866de34-a86d-49ea-a7f1-e0ded15c1034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e6b5ac9-b903-4505-b6dc-018b8e14a1c9', 'volume_name': 'volume-2e6b5ac9-b903-4505-b6dc-018b8e14a1c9', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7c320e-12bb-4269-a05d-dd4d0a353b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7c320e-12bb-4269-a05d-dd4d0a353b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (289c2e3c-3ce0-4b7f-b6ce-ac094f1667ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:26 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Volume 2e6b5ac9-b903-4505-b6dc-018b8e14a1c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e6b5ac9-b903-4505-b6dc-018b8e14a1c9', 'volume_size': 1} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c12f818f-c15c-4785-a19b-21ad346c89f7 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-23456be6-9408-4b8e-be96-1e4855066929" returned: 0 in 0.531s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c12f818f-c15c-4785-a19b-21ad346c89f7 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-quobyte-23456be6-9408-4b8e-be96-1e4855066929" released by "delete_volume" :: held 1.050s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:26 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fc23b98e-e4c5-487d-80e1-c342936f22df tempest-SnapshotDependencyTests-198707550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa21df73-27b0-4824-892a-143749024acd -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.179fa9c3-f3cb-44f2-84c9-e54844205de0" returned: 0 in 0.572s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:26 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-fc23b98e-e4c5-487d-80e1-c342936f22df tempest-SnapshotDependencyTests-198707550 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.179fa9c3-f3cb-44f2-84c9-e54844205de0 is being set with open permissions: ugo+rw Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fc23b98e-e4c5-487d-80e1-c342936f22df tempest-SnapshotDependencyTests-198707550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.179fa9c3-f3cb-44f2-84c9-e54844205de0 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-c12f818f-c15c-4785-a19b-21ad346c89f7 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Created reservations ['16f26022-82d2-471a-991f-038f9e9c7662', '255f87ac-e16f-4f48-bd38-37ebcaa822b4', '0f03db37-8bc1-4c9e-b48e-9f3ba5c24961', 'd1609319-6186-4b03-aa34-9b773337d728'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:26 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.179fa9c3-f3cb-44f2-84c9-e54844205de0 Apr 21 21:01:26 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Flow 'volume_create_manager' (9acc6dc0-9000-466f-9ae6-c0c25479b3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58400495-151d-4351-b3fc-0381c1bf6dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:26 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c12f818f-c15c-4785-a19b-21ad346c89f7 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c12f818f-c15c-4785-a19b-21ad346c89f7 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c12f818f-c15c-4785-a19b-21ad346c89f7 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c12f818f-c15c-4785-a19b-21ad346c89f7 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c12f818f-c15c-4785-a19b-21ad346c89f7 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:26 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c12f818f-c15c-4785-a19b-21ad346c89f7 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c5a3bdf7-b86c-4243-89cd-b5a9b8215ed0 tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.e76e83fb-efd6-48e5-8a16-cc76b6f2c44f" returned: 0 in 0.559s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c5a3bdf7-b86c-4243-89cd-b5a9b8215ed0 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.e76e83fb-efd6-48e5-8a16-cc76b6f2c44f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:27 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:27 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58400495-151d-4351-b3fc-0381c1bf6dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-18483469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b26ffb7-b3aa-4c14-b038-829bb1f46034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346e52fb33b642f09beb70cd3bd303dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:27Z,use_quota=True,user_id='d86e0664e847453b820999cbb20033b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871ae9ca-3ca2-4374-82dc-0238edd58cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871ae9ca-3ca2-4374-82dc-0238edd58cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1988ec90-ee99-4d7f-9caa-b6f2525a5fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1988ec90-ee99-4d7f-9caa-b6f2525a5fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b26ffb7-b3aa-4c14-b038-829bb1f46034', 'volume_name': 'volume-6b26ffb7-b3aa-4c14-b038-829bb1f46034', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2654698-e6dd-427f-bcbd-6eeb420dea4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2654698-e6dd-427f-bcbd-6eeb420dea4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a38c2c4-511d-4273-b97a-ab1a12f7e0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:27 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Volume 6b26ffb7-b3aa-4c14-b038-829bb1f46034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b26ffb7-b3aa-4c14-b038-829bb1f46034', 'volume_size': 1} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:27 devstack sudo[90422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.e76e83fb-efd6-48e5-8a16-cc76b6f2c44f Apr 21 21:01:27 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Flow 'volume_create_manager' (a4b62440-5b46-4854-94e1-0707c9c99e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b792c63-fc2a-4f8a-ba5b-9a9e6814706e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b792c63-fc2a-4f8a-ba5b-9a9e6814706e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-950599474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6736285-2be0-4e2f-999a-1ef1b1af122a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346e52fb33b642f09beb70cd3bd303dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:27Z,use_quota=True,user_id='d86e0664e847453b820999cbb20033b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe5c4de1-9921-40ce-b139-ca2537839b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe5c4de1-9921-40ce-b139-ca2537839b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff913af9-4efd-4ed0-8f90-ab60303b223a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff913af9-4efd-4ed0-8f90-ab60303b223a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6736285-2be0-4e2f-999a-1ef1b1af122a', 'volume_name': 'volume-c6736285-2be0-4e2f-999a-1ef1b1af122a', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b054413-f17e-42a2-ae27-07b067d65dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b054413-f17e-42a2-ae27-07b067d65dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586aa80f-9b24-4285-afb2-aeafaf79f402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:27 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Volume c6736285-2be0-4e2f-999a-1ef1b1af122a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6736285-2be0-4e2f-999a-1ef1b1af122a', 'volume_size': 1} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Flow 'volume_create_manager' (7559bdab-48b2-46be-a287-22b28a2be243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6035568-18a7-4b39-ad91-9217b7323264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6035568-18a7-4b39-ad91-9217b7323264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1352663418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e71ad52-fa79-49d3-8436-b072ac08ade5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346e52fb33b642f09beb70cd3bd303dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:27Z,use_quota=True,user_id='d86e0664e847453b820999cbb20033b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abbd6458-3159-40ff-a4d8-49849c60df0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abbd6458-3159-40ff-a4d8-49849c60df0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e961d48-e87c-4bad-bd38-7aac715d7572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e961d48-e87c-4bad-bd38-7aac715d7572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e71ad52-fa79-49d3-8436-b072ac08ade5', 'volume_name': 'volume-8e71ad52-fa79-49d3-8436-b072ac08ade5', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (711ef9be-4916-4748-84de-8a505e8f7586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (711ef9be-4916-4748-84de-8a505e8f7586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37c11aa-c769-4fd3-8f1b-bea3e57b7d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:27 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Volume 8e71ad52-fa79-49d3-8436-b072ac08ade5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e71ad52-fa79-49d3-8436-b072ac08ade5', 'volume_size': 1} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:27 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c5a3bdf7-b86c-4243-89cd-b5a9b8215ed0 tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf.e76e83fb-efd6-48e5-8a16-cc76b6f2c44f" returned: 0 in 0.556s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5a3bdf7-b86c-4243-89cd-b5a9b8215ed0 tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-quobyte-e76e83fb-efd6-48e5-8a16-cc76b6f2c44f" released by "_delete_snapshot" :: held 2.231s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Flow 'volume_create_manager' (42c46821-a7aa-48d1-be99-d2726be31d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98df05aa-9945-41cf-9b4d-321777c0b7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:27 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5a3bdf7-b86c-4243-89cd-b5a9b8215ed0 tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-quobyte-0daaeb98-668d-4d83-8a42-03ed5e214ddf" released by "delete_snapshot" :: held 2.276s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98df05aa-9945-41cf-9b4d-321777c0b7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-338894303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7510349-ef0f-4916-b02e-36cb8d87b269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346e52fb33b642f09beb70cd3bd303dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:28Z,use_quota=True,user_id='d86e0664e847453b820999cbb20033b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f29ed787-24cd-4d59-a67d-b19cd3f5de1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:27 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f29ed787-24cd-4d59-a67d-b19cd3f5de1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b742f1b-aaf3-41f7-8fda-1681e6a0aa60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b742f1b-aaf3-41f7-8fda-1681e6a0aa60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7510349-ef0f-4916-b02e-36cb8d87b269', 'volume_name': 'volume-a7510349-ef0f-4916-b02e-36cb8d87b269', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9cb99a-4f27-44d7-8046-9df9a375ab44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9cb99a-4f27-44d7-8046-9df9a375ab44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4824f8e8-8644-4842-81e3-81e0c9202d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:27 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Volume a7510349-ef0f-4916-b02e-36cb8d87b269: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7510349-ef0f-4916-b02e-36cb8d87b269', 'volume_size': 1} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c12f818f-c15c-4785-a19b-21ad346c89f7 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.677s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-c12f818f-c15c-4785-a19b-21ad346c89f7 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fc23b98e-e4c5-487d-80e1-c342936f22df tempest-SnapshotDependencyTests-198707550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.179fa9c3-f3cb-44f2-84c9-e54844205de0" returned: 0 in 0.812s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:27 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-c12f818f-c15c-4785-a19b-21ad346c89f7 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Deleted volume successfully. Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c12f818f-c15c-4785-a19b-21ad346c89f7 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-23456be6-9408-4b8e-be96-1e4855066929-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fc23b98e-e4c5-487d-80e1-c342936f22df tempest-SnapshotDependencyTests-198707550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:27 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.info Apr 21 21:01:27 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-c5a3bdf7-b86c-4243-89cd-b5a9b8215ed0 tempest-VolumeDependencyTests-1493625113 None] Created reservations ['caf307a3-386f-499c-9fc8-4537fa3a74ee', '69f288f8-9bdc-402d-8ab7-f0ad911bd968', '760a522e-a57b-434f-bc04-33929b8b2fe7', '635f09af-690d-4a84-8871-17eb92b62be1'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:27 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-c5a3bdf7-b86c-4243-89cd-b5a9b8215ed0 tempest-VolumeDependencyTests-1493625113 None] Delete snapshot completed successfully. Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c5a3bdf7-b86c-4243-89cd-b5a9b8215ed0 tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-e76e83fb-efd6-48e5-8a16-cc76b6f2c44f-delete_snapshot" released by "delete_snapshot" :: held 2.468s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bebe1c26-b4f0-4b85-a291-af85984953b0 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "cinder-cdca95a8-9546-4c6c-9be4-f55542eea9f1-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bebe1c26-b4f0-4b85-a291-af85984953b0 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-cdca95a8-9546-4c6c-9be4-f55542eea9f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bebe1c26-b4f0-4b85-a291-af85984953b0 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "cinder-quobyte-15eba763-be1e-486b-a914-5150c64b7d35" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bebe1c26-b4f0-4b85-a291-af85984953b0 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-quobyte-15eba763-be1e-486b-a914-5150c64b7d35" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bebe1c26-b4f0-4b85-a291-af85984953b0 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "cinder-quobyte-cdca95a8-9546-4c6c-9be4-f55542eea9f1" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bebe1c26-b4f0-4b85-a291-af85984953b0 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-quobyte-cdca95a8-9546-4c6c-9be4-f55542eea9f1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:27 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-bebe1c26-b4f0-4b85-a291-af85984953b0 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Deleting offline snapshot cdca95a8-9546-4c6c-9be4-f55542eea9f1 of volume 15eba763-be1e-486b-a914-5150c64b7d35 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-bebe1c26-b4f0-4b85-a291-af85984953b0 tempest-CreateVolumesFromSnapshotTest-1221784384 None] snapshot_file for this snap is: volume-15eba763-be1e-486b-a914-5150c64b7d35.cdca95a8-9546-4c6c-9be4-f55542eea9f1 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2f8439-008c-4bf4-ae76-ec95b8dd89ea]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bebe1c26-b4f0-4b85-a291-af85984953b0 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.cdca95a8-9546-4c6c-9be4-f55542eea9f1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:28 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.cdca95a8-9546-4c6c-9be4-f55542eea9f1 Apr 21 21:01:28 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:28 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fc23b98e-e4c5-487d-80e1-c342936f22df tempest-SnapshotDependencyTests-198707550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.info" returned: 0 in 0.441s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:28 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-fc23b98e-e4c5-487d-80e1-c342936f22df tempest-SnapshotDependencyTests-198707550 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.info is being set with open permissions: ugo+rw Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fc23b98e-e4c5-487d-80e1-c342936f22df tempest-SnapshotDependencyTests-198707550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:28 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.info Apr 21 21:01:28 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b18ed47d-ec24-462c-87f4-049cc8c996cb tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "cinder-0daaeb98-668d-4d83-8a42-03ed5e214ddf-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:28 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bebe1c26-b4f0-4b85-a291-af85984953b0 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.cdca95a8-9546-4c6c-9be4-f55542eea9f1" returned: 0 in 0.506s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-bebe1c26-b4f0-4b85-a291-af85984953b0 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15eba763-be1e-486b-a914-5150c64b7d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b18ed47d-ec24-462c-87f4-049cc8c996cb tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-0daaeb98-668d-4d83-8a42-03ed5e214ddf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eafa292-b4f8-4962-881d-b036b8d46ebd]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bebe1c26-b4f0-4b85-a291-af85984953b0 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b18ed47d-ec24-462c-87f4-049cc8c996cb tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "cinder-quobyte-0daaeb98-668d-4d83-8a42-03ed5e214ddf" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b18ed47d-ec24-462c-87f4-049cc8c996cb tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-quobyte-0daaeb98-668d-4d83-8a42-03ed5e214ddf" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ecf468-8735-4d21-8be8-ab5d59f9a440]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b18ed47d-ec24-462c-87f4-049cc8c996cb tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:28 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-fc23b98e-e4c5-487d-80e1-c342936f22df tempest-SnapshotDependencyTests-198707550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.info" returned: 0 in 0.445s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:28 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35 Apr 21 21:01:28 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-fc23b98e-e4c5-487d-80e1-c342936f22df tempest-SnapshotDependencyTests-198707550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.429s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.840s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1984264690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6b5ac9-b903-4505-b6dc-018b8e14a1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346e52fb33b642f09beb70cd3bd303dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:27Z,use_quota=True,user_id='d86e0664e847453b820999cbb20033b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Creating volume 2e6b5ac9-b903-4505-b6dc-018b8e14a1c9 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:28 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:01:28 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2e6b5ac9-b903-4505-b6dc-018b8e14a1c9 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:28 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2e6b5ac9-b903-4505-b6dc-018b8e14a1c9 1073741824 Apr 21 21:01:28 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:28 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-fc23b98e-e4c5-487d-80e1-c342936f22df tempest-SnapshotDependencyTests-198707550 None] Create snapshot completed successfully Apr 21 21:01:28 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf Apr 21 21:01:28 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:29 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bebe1c26-b4f0-4b85-a291-af85984953b0 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35" returned: 0 in 0.539s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bebe1c26-b4f0-4b85-a291-af85984953b0 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.cdca95a8-9546-4c6c-9be4-f55542eea9f1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:29 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.cdca95a8-9546-4c6c-9be4-f55542eea9f1 Apr 21 21:01:29 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:29 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b18ed47d-ec24-462c-87f4-049cc8c996cb tempest-VolumeDependencyTests-1493625113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf" returned: 0 in 0.496s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b18ed47d-ec24-462c-87f4-049cc8c996cb tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:29 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2e6b5ac9-b903-4505-b6dc-018b8e14a1c9 1073741824" returned: 0 in 0.479s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:29 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf Apr 21 21:01:29 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2e6b5ac9-b903-4505-b6dc-018b8e14a1c9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:29 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2e6b5ac9-b903-4505-b6dc-018b8e14a1c9 Apr 21 21:01:29 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:29 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b18ed47d-ec24-462c-87f4-049cc8c996cb tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-0daaeb98-668d-4d83-8a42-03ed5e214ddf" returned: 0 in 0.416s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b18ed47d-ec24-462c-87f4-049cc8c996cb tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-quobyte-0daaeb98-668d-4d83-8a42-03ed5e214ddf" released by "delete_volume" :: held 0.957s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-b18ed47d-ec24-462c-87f4-049cc8c996cb tempest-VolumeDependencyTests-1493625113 None] Created reservations ['cb97e9f1-d96c-4ec9-97a6-18db0bf42cff', 'fafdb0d1-aeb0-4c1d-873e-eeeb09bfbfb1', 'a8d21cd9-9cfd-4469-838e-e543de72c150', '558d1a94-f49d-4ac6-8a36-07ad705bf4f3'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:29 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bebe1c26-b4f0-4b85-a291-af85984953b0 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.cdca95a8-9546-4c6c-9be4-f55542eea9f1" returned: 0 in 0.525s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bebe1c26-b4f0-4b85-a291-af85984953b0 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.cdca95a8-9546-4c6c-9be4-f55542eea9f1 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:29 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.cdca95a8-9546-4c6c-9be4-f55542eea9f1 Apr 21 21:01:29 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b18ed47d-ec24-462c-87f4-049cc8c996cb tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b18ed47d-ec24-462c-87f4-049cc8c996cb tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b18ed47d-ec24-462c-87f4-049cc8c996cb tempest-VolumeDependencyTests-1493625113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b18ed47d-ec24-462c-87f4-049cc8c996cb tempest-VolumeDependencyTests-1493625113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b18ed47d-ec24-462c-87f4-049cc8c996cb tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b18ed47d-ec24-462c-87f4-049cc8c996cb tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:29 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2e6b5ac9-b903-4505-b6dc-018b8e14a1c9" returned: 0 in 0.519s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:29 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.620s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:29 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-18483469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b26ffb7-b3aa-4c14-b038-829bb1f46034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346e52fb33b642f09beb70cd3bd303dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:27Z,use_quota=True,user_id='d86e0664e847453b820999cbb20033b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Creating volume 6b26ffb7-b3aa-4c14-b038-829bb1f46034 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:29 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6b26ffb7-b3aa-4c14-b038-829bb1f46034 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (289c2e3c-3ce0-4b7f-b6ce-ac094f1667ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e6b5ac9-b903-4505-b6dc-018b8e14a1c9', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f0e3f21-413c-40d4-be91-c9329fde3c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:29 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6b26ffb7-b3aa-4c14-b038-829bb1f46034 1073741824 Apr 21 21:01:29 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:29 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Volume volume-2e6b5ac9-b903-4505-b6dc-018b8e14a1c9 (2e6b5ac9-b903-4505-b6dc-018b8e14a1c9): created successfully Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f0e3f21-413c-40d4-be91-c9329fde3c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Flow 'volume_create_manager' (b55302f0-4e88-4aec-be1f-6d0376542e74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:29 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-92d8ad92-eff8-450f-b253-69d513125793 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Created volume successfully. Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Flow 'volume_create_manager' (35834d01-4a1f-4f5f-ba11-cc3904a12113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbd9f18-6809-4f09-9f75-73fb910ca8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbd9f18-6809-4f09-9f75-73fb910ca8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6393664-ceed-4a82-a275-38af9235313f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f83f5046069e45dcba0cf934080963d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=179fa9c3-f3cb-44f2-84c9-e54844205de0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:30Z,use_quota=True,user_id='ec6350e1a3254001997c6caa0b2939af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d896112f-6cfe-4568-b848-254d81d3b865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d896112f-6cfe-4568-b848-254d81d3b865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64e0547-2eeb-46e0-8dc0-1eeb40b171fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64e0547-2eeb-46e0-8dc0-1eeb40b171fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd6393664-ceed-4a82-a275-38af9235313f', 'volume_name': 'volume-d6393664-ceed-4a82-a275-38af9235313f', 'volume_size': 1, 'snapshot_id': '179fa9c3-f3cb-44f2-84c9-e54844205de0'}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12a8472-4d96-42af-9e2a-8397cb02a09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12a8472-4d96-42af-9e2a-8397cb02a09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f83d00-15d3-4f22-a276-7e44642bf9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:29 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Volume d6393664-ceed-4a82-a275-38af9235313f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d6393664-ceed-4a82-a275-38af9235313f', 'volume_size': 1, 'snapshot_id': '179fa9c3-f3cb-44f2-84c9-e54844205de0'} Apr 21 21:01:29 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:30 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bebe1c26-b4f0-4b85-a291-af85984953b0 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35.cdca95a8-9546-4c6c-9be4-f55542eea9f1" returned: 0 in 0.438s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bebe1c26-b4f0-4b85-a291-af85984953b0 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-quobyte-cdca95a8-9546-4c6c-9be4-f55542eea9f1" released by "_delete_snapshot" :: held 2.075s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bebe1c26-b4f0-4b85-a291-af85984953b0 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-quobyte-15eba763-be1e-486b-a914-5150c64b7d35" released by "delete_snapshot" :: held 2.094s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-bebe1c26-b4f0-4b85-a291-af85984953b0 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Created reservations ['f4c5f96a-653d-4111-9182-f4ef221fc481', '0c74f1ea-bed3-4c44-93e4-cd75d3600829', '088ca2ec-9bde-43ef-b0bd-c3d6378272fb', '3a05fa6c-ee41-4c54-9585-c976758b8c0a'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:30 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-bebe1c26-b4f0-4b85-a291-af85984953b0 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Delete snapshot completed successfully. Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bebe1c26-b4f0-4b85-a291-af85984953b0 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-cdca95a8-9546-4c6c-9be4-f55542eea9f1-delete_snapshot" released by "delete_snapshot" :: held 2.170s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:30 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b18ed47d-ec24-462c-87f4-049cc8c996cb tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.548s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-b18ed47d-ec24-462c-87f4-049cc8c996cb tempest-VolumeDependencyTests-1493625113 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:30 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-b18ed47d-ec24-462c-87f4-049cc8c996cb tempest-VolumeDependencyTests-1493625113 None] Deleted volume successfully. Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-b18ed47d-ec24-462c-87f4-049cc8c996cb tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-0daaeb98-668d-4d83-8a42-03ed5e214ddf-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:30 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6b26ffb7-b3aa-4c14-b038-829bb1f46034 1073741824" returned: 0 in 0.593s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6b26ffb7-b3aa-4c14-b038-829bb1f46034 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:30 devstack sudo[90477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6b26ffb7-b3aa-4c14-b038-829bb1f46034 Apr 21 21:01:30 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:30 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6b26ffb7-b3aa-4c14-b038-829bb1f46034" returned: 0 in 0.431s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.397s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-950599474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6736285-2be0-4e2f-999a-1ef1b1af122a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346e52fb33b642f09beb70cd3bd303dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:27Z,use_quota=True,user_id='d86e0664e847453b820999cbb20033b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Creating volume c6736285-2be0-4e2f-999a-1ef1b1af122a {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:30 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c6736285-2be0-4e2f-999a-1ef1b1af122a 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a38c2c4-511d-4273-b97a-ab1a12f7e0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b26ffb7-b3aa-4c14-b038-829bb1f46034', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:30 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c6736285-2be0-4e2f-999a-1ef1b1af122a 1073741824 Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92a1edd-b266-49bd-b7f2-7deabbb58884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:30 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:30 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Volume volume-6b26ffb7-b3aa-4c14-b038-829bb1f46034 (6b26ffb7-b3aa-4c14-b038-829bb1f46034): created successfully Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92a1edd-b266-49bd-b7f2-7deabbb58884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Flow 'volume_create_manager' (9acc6dc0-9000-466f-9ae6-c0c25479b3c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:30 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-31315999-ad49-4446-a68d-e2f18f26d3e7 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Created volume successfully. Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Flow 'volume_create_manager' (e25713b7-e76e-492d-a2a0-7fce461aba72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6a75746-b8cd-41d2-bb43-ef3e9013b9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6a75746-b8cd-41d2-bb43-ef3e9013b9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1020962637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='990e76bea3b5471b8ea4aeaa9c902fdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:31Z,use_quota=True,user_id='8088ea50ab7a444b872d62cf6f480937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (521ad2c0-8633-48f3-bcc9-a6adad61632c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (521ad2c0-8633-48f3-bcc9-a6adad61632c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58441ce-36b9-4996-8143-7657851ef426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58441ce-36b9-4996-8143-7657851ef426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc', 'volume_name': 'volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (796160b3-64ca-46a6-b89d-22f8b2afa657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (796160b3-64ca-46a6-b89d-22f8b2afa657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf2e2c1-9659-4715-99bf-1b9f38564210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:30 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Volume 9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc', 'volume_size': 1} Apr 21 21:01:30 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f32efea4-030f-4b93-8803-0d57c3695e33 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "cinder-15eba763-be1e-486b-a914-5150c64b7d35-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f32efea4-030f-4b93-8803-0d57c3695e33 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-15eba763-be1e-486b-a914-5150c64b7d35-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f32efea4-030f-4b93-8803-0d57c3695e33 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "cinder-quobyte-15eba763-be1e-486b-a914-5150c64b7d35" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f32efea4-030f-4b93-8803-0d57c3695e33 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-quobyte-15eba763-be1e-486b-a914-5150c64b7d35" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[55976b7d-c4a7-4c2f-a4ff-05d3987bef12]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f32efea4-030f-4b93-8803-0d57c3695e33 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:31 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35 Apr 21 21:01:31 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:31 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c6736285-2be0-4e2f-999a-1ef1b1af122a 1073741824" returned: 0 in 0.552s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c6736285-2be0-4e2f-999a-1ef1b1af122a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:31 devstack sudo[90487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c6736285-2be0-4e2f-999a-1ef1b1af122a Apr 21 21:01:31 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:31 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f32efea4-030f-4b93-8803-0d57c3695e33 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35" returned: 0 in 0.535s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f32efea4-030f-4b93-8803-0d57c3695e33 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:31 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c6736285-2be0-4e2f-999a-1ef1b1af122a" returned: 0 in 0.395s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.214s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1352663418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e71ad52-fa79-49d3-8436-b072ac08ade5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346e52fb33b642f09beb70cd3bd303dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:27Z,use_quota=True,user_id='d86e0664e847453b820999cbb20033b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Creating volume 8e71ad52-fa79-49d3-8436-b072ac08ade5 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:31 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35 Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:31 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:31 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8e71ad52-fa79-49d3-8436-b072ac08ade5 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586aa80f-9b24-4285-afb2-aeafaf79f402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6736285-2be0-4e2f-999a-1ef1b1af122a', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:31 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8e71ad52-fa79-49d3-8436-b072ac08ade5 1073741824 Apr 21 21:01:31 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a67b03b8-b91d-438b-9fc4-bdf6debceaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:31 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Volume volume-c6736285-2be0-4e2f-999a-1ef1b1af122a (c6736285-2be0-4e2f-999a-1ef1b1af122a): created successfully Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a67b03b8-b91d-438b-9fc4-bdf6debceaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:31 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Flow 'volume_create_manager' (a4b62440-5b46-4854-94e1-0707c9c99e10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:31 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-9ceba4c3-7b5d-4edd-872e-38c4622af243 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Created volume successfully. Apr 21 21:01:32 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f32efea4-030f-4b93-8803-0d57c3695e33 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-15eba763-be1e-486b-a914-5150c64b7d35" returned: 0 in 0.458s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f32efea4-030f-4b93-8803-0d57c3695e33 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-quobyte-15eba763-be1e-486b-a914-5150c64b7d35" released by "delete_volume" :: held 1.032s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-f32efea4-030f-4b93-8803-0d57c3695e33 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Created reservations ['2f2d4fd9-791d-4209-9eab-5fb71f8b8c52', '23625087-b988-4849-88b3-e5e96b153644', '749fc627-4baa-4269-8023-92d8d7244257', 'ebcd4f43-d68f-4ad1-8c11-6b6e305f93b0'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f32efea4-030f-4b93-8803-0d57c3695e33 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f32efea4-030f-4b93-8803-0d57c3695e33 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f32efea4-030f-4b93-8803-0d57c3695e33 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f32efea4-030f-4b93-8803-0d57c3695e33 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f32efea4-030f-4b93-8803-0d57c3695e33 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f32efea4-030f-4b93-8803-0d57c3695e33 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:32 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8e71ad52-fa79-49d3-8436-b072ac08ade5 1073741824" returned: 0 in 0.534s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:32 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:32 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8e71ad52-fa79-49d3-8436-b072ac08ade5 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:32 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8e71ad52-fa79-49d3-8436-b072ac08ade5 Apr 21 21:01:32 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:32 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f32efea4-030f-4b93-8803-0d57c3695e33 tempest-CreateVolumesFromSnapshotTest-1221784384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.397s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-f32efea4-030f-4b93-8803-0d57c3695e33 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:32 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-f32efea4-030f-4b93-8803-0d57c3695e33 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Deleted volume successfully. Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f32efea4-030f-4b93-8803-0d57c3695e33 tempest-CreateVolumesFromSnapshotTest-1221784384 None] Lock "cinder-15eba763-be1e-486b-a914-5150c64b7d35-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:32 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8e71ad52-fa79-49d3-8436-b072ac08ade5" returned: 0 in 0.444s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.085s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-338894303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7510349-ef0f-4916-b02e-36cb8d87b269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346e52fb33b642f09beb70cd3bd303dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:28Z,use_quota=True,user_id='d86e0664e847453b820999cbb20033b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Creating volume a7510349-ef0f-4916-b02e-36cb8d87b269 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:32 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a7510349-ef0f-4916-b02e-36cb8d87b269 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37c11aa-c769-4fd3-8f1b-bea3e57b7d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e71ad52-fa79-49d3-8436-b072ac08ade5', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:32 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a7510349-ef0f-4916-b02e-36cb8d87b269 1073741824 Apr 21 21:01:32 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0e7368-73b9-49ed-9257-4a50c4cc3508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:32 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Volume volume-8e71ad52-fa79-49d3-8436-b072ac08ade5 (8e71ad52-fa79-49d3-8436-b072ac08ade5): created successfully Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0e7368-73b9-49ed-9257-4a50c4cc3508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:32 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Flow 'volume_create_manager' (7559bdab-48b2-46be-a287-22b28a2be243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:32 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-7278cf23-22e9-42f8-b759-30e84b990b77 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Created volume successfully. Apr 21 21:01:33 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a7510349-ef0f-4916-b02e-36cb8d87b269 1073741824" returned: 0 in 0.494s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a7510349-ef0f-4916-b02e-36cb8d87b269 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:33 devstack sudo[90512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a7510349-ef0f-4916-b02e-36cb8d87b269 Apr 21 21:01:33 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:33 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a7510349-ef0f-4916-b02e-36cb8d87b269" returned: 0 in 0.459s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.823s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Acquiring lock "cinder-quobyte-179fa9c3-f3cb-44f2-84c9-e54844205de0-d6393664-ceed-4a82-a275-38af9235313f" by "_create_volume_from_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4824f8e8-8644-4842-81e3-81e0c9202d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7510349-ef0f-4916-b02e-36cb8d87b269', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81613fb6-173c-48a2-ba2a-903276035042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:33 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Volume volume-a7510349-ef0f-4916-b02e-36cb8d87b269 (a7510349-ef0f-4916-b02e-36cb8d87b269): created successfully Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81613fb6-173c-48a2-ba2a-903276035042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Flow 'volume_create_manager' (42c46821-a7aa-48d1-be99-d2726be31d28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Lock "cinder-quobyte-179fa9c3-f3cb-44f2-84c9-e54844205de0-d6393664-ceed-4a82-a275-38af9235313f" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Creating volume d6393664-ceed-4a82-a275-38af9235313f from snapshot 179fa9c3-f3cb-44f2-84c9-e54844205de0 {{(pid=81957) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Acquiring lock "cinder-quobyte-d6393664-ceed-4a82-a275-38af9235313f" by "_copy_volume_from_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:33 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-ea3f313f-aee5-47f3-b17b-8ea1cfcbaf19 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Created volume successfully. Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Lock "cinder-quobyte-d6393664-ceed-4a82-a275-38af9235313f" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] snapshot: 179fa9c3-f3cb-44f2-84c9-e54844205de0, volume: d6393664-ceed-4a82-a275-38af9235313f, {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9b7bd9-13bd-435c-80f7-c2076823c0c0]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:33 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.179fa9c3-f3cb-44f2-84c9-e54844205de0 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:33 devstack sudo[90515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.179fa9c3-f3cb-44f2-84c9-e54844205de0 Apr 21 21:01:33 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:34 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a2ec2325-6d2b-4199-9d10-5d47c58f9b99 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "cinder-a7510349-ef0f-4916-b02e-36cb8d87b269-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:34 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a2ec2325-6d2b-4199-9d10-5d47c58f9b99 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-a7510349-ef0f-4916-b02e-36cb8d87b269-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:34 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a2ec2325-6d2b-4199-9d10-5d47c58f9b99 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "cinder-quobyte-a7510349-ef0f-4916-b02e-36cb8d87b269" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:34 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a2ec2325-6d2b-4199-9d10-5d47c58f9b99 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-quobyte-a7510349-ef0f-4916-b02e-36cb8d87b269" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:34 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7aee609-a527-400c-ad14-0fdce94f28ed]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a2ec2325-6d2b-4199-9d10-5d47c58f9b99 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a7510349-ef0f-4916-b02e-36cb8d87b269 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:34 devstack sudo[90518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a7510349-ef0f-4916-b02e-36cb8d87b269 Apr 21 21:01:34 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:34 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.179fa9c3-f3cb-44f2-84c9-e54844205de0" returned: 0 in 0.608s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:34 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa21df73-27b0-4824-892a-143749024acd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:01:34 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 21:01:34 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Creating direct copy from snapshot {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 21:01:34 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bb4b51-8e82-4df5-a90d-54d686676eab]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:34 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd Apr 21 21:01:34 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:34 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a2ec2325-6d2b-4199-9d10-5d47c58f9b99 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a7510349-ef0f-4916-b02e-36cb8d87b269" returned: 0 in 0.543s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a2ec2325-6d2b-4199-9d10-5d47c58f9b99 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a7510349-ef0f-4916-b02e-36cb8d87b269 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:34 devstack sudo[90528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a7510349-ef0f-4916-b02e-36cb8d87b269 Apr 21 21:01:34 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:34 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd" returned: 0 in 0.539s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:34 devstack cinder-volume[81957]: DEBUG cinder.utils [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Path /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d6393664-ceed-4a82-a275-38af9235313f not found in is_blk_device check {{(pid=81957) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 21:01:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d6393664-ceed-4a82-a275-38af9235313f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:35 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d6393664-ceed-4a82-a275-38af9235313f Apr 21 21:01:35 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:35 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Flow 'volume_create_manager' (29de5e0c-434a-4cce-ab5f-e4f52a3c6fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b421e910-e784-45a2-aa4f-d81031a5d923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b421e910-e784-45a2-aa4f-d81031a5d923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b17daa838b49bf9ab20a515513a9ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:35Z,use_quota=True,user_id='92be3fe238ac480c85736aa94bfe8578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27888831-0952-4eb0-8471-7e312ce788a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27888831-0952-4eb0-8471-7e312ce788a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650bd449-f0ba-438a-b3ca-1a028a073c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650bd449-f0ba-438a-b3ca-1a028a073c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7', 'volume_name': 'volume-6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f81c90-d611-4a90-a8ae-7ea758ec2447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:35 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f81c90-d611-4a90-a8ae-7ea758ec2447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:35 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8739ceb1-f4ca-42e4-b86c-f8ac19f9704a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:35 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Volume 6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7', 'volume_size': 1} Apr 21 21:01:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a2ec2325-6d2b-4199-9d10-5d47c58f9b99 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-a7510349-ef0f-4916-b02e-36cb8d87b269" returned: 0 in 0.465s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:35 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a2ec2325-6d2b-4199-9d10-5d47c58f9b99 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-quobyte-a7510349-ef0f-4916-b02e-36cb8d87b269" released by "delete_volume" :: held 1.034s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:35 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-a2ec2325-6d2b-4199-9d10-5d47c58f9b99 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Created reservations ['a33d7cf4-a907-42a8-b699-8f7e6960ed88', '0c211f13-5f10-4458-82bb-f3ecab4b6ea5', '4c456101-f9fd-4e4b-95f8-a2d9ad9dfc31', 'ba32a119-409a-4583-8438-28adebda65d0'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a2ec2325-6d2b-4199-9d10-5d47c58f9b99 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a2ec2325-6d2b-4199-9d10-5d47c58f9b99 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:35 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a2ec2325-6d2b-4199-9d10-5d47c58f9b99 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:35 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a2ec2325-6d2b-4199-9d10-5d47c58f9b99 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a2ec2325-6d2b-4199-9d10-5d47c58f9b99 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a2ec2325-6d2b-4199-9d10-5d47c58f9b99 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:35 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:35 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:36 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a2ec2325-6d2b-4199-9d10-5d47c58f9b99 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.990s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:36 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-a2ec2325-6d2b-4199-9d10-5d47c58f9b99 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:36 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-a2ec2325-6d2b-4199-9d10-5d47c58f9b99 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Deleted volume successfully. Apr 21 21:01:36 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a2ec2325-6d2b-4199-9d10-5d47c58f9b99 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-a7510349-ef0f-4916-b02e-36cb8d87b269-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:36 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-30f19a4d-d4b3-4d9c-b0a1-eb667dc567dc tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "cinder-8e71ad52-fa79-49d3-8436-b072ac08ade5-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:36 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-30f19a4d-d4b3-4d9c-b0a1-eb667dc567dc tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-8e71ad52-fa79-49d3-8436-b072ac08ade5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:36 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-30f19a4d-d4b3-4d9c-b0a1-eb667dc567dc tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "cinder-quobyte-8e71ad52-fa79-49d3-8436-b072ac08ade5" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:36 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-30f19a4d-d4b3-4d9c-b0a1-eb667dc567dc tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-quobyte-8e71ad52-fa79-49d3-8436-b072ac08ade5" acquired by "delete_volume" :: waited 0.026s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:36 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c8651f-c2f2-4a87-b5d5-82e02b3413a7]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-30f19a4d-d4b3-4d9c-b0a1-eb667dc567dc tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8e71ad52-fa79-49d3-8436-b072ac08ade5 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:37 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8e71ad52-fa79-49d3-8436-b072ac08ade5 Apr 21 21:01:37 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:37 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d6393664-ceed-4a82-a275-38af9235313f" returned: 0 in 2.114s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:37 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[251f6f9e-9b2c-478f-8c6b-a505caabbda9]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:37 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd Apr 21 21:01:37 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:37 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-30f19a4d-d4b3-4d9c-b0a1-eb667dc567dc tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8e71ad52-fa79-49d3-8436-b072ac08ade5" returned: 0 in 0.707s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-30f19a4d-d4b3-4d9c-b0a1-eb667dc567dc tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8e71ad52-fa79-49d3-8436-b072ac08ade5 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:37 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8e71ad52-fa79-49d3-8436-b072ac08ade5 Apr 21 21:01:37 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:37 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd" returned: 0 in 0.622s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:37 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd, size 1024.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d6393664-ceed-4a82-a275-38af9235313f {{(pid=81957) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 21:01:37 devstack cinder-volume[81957]: INFO cinder.image.image_utils [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Converted 1024.00 MB image at 484.01 MB/s Apr 21 21:01:37 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d6393664-ceed-4a82-a275-38af9235313f is being set with open permissions: ugo+rw Apr 21 21:01:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d6393664-ceed-4a82-a275-38af9235313f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:37 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d6393664-ceed-4a82-a275-38af9235313f Apr 21 21:01:37 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:37 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-30f19a4d-d4b3-4d9c-b0a1-eb667dc567dc tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8e71ad52-fa79-49d3-8436-b072ac08ade5" returned: 0 in 0.423s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:37 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-30f19a4d-d4b3-4d9c-b0a1-eb667dc567dc tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-quobyte-8e71ad52-fa79-49d3-8436-b072ac08ade5" released by "delete_volume" :: held 1.171s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:37 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-30f19a4d-d4b3-4d9c-b0a1-eb667dc567dc tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Created reservations ['48bee38d-4ad5-4aa7-8a3b-e202a814bc58', 'a7f69eed-b30d-46be-982b-c49a7de593e5', 'f2a66e85-95a3-4143-98e3-1dc35516ff48', '97ae0830-5ed6-45ee-8ad3-66d6453c8604'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-30f19a4d-d4b3-4d9c-b0a1-eb667dc567dc tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-30f19a4d-d4b3-4d9c-b0a1-eb667dc567dc tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:37 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-30f19a4d-d4b3-4d9c-b0a1-eb667dc567dc tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:37 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-30f19a4d-d4b3-4d9c-b0a1-eb667dc567dc tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-30f19a4d-d4b3-4d9c-b0a1-eb667dc567dc tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:37 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-30f19a4d-d4b3-4d9c-b0a1-eb667dc567dc tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:37 devstack sudo[90570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:37 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:38 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d6393664-ceed-4a82-a275-38af9235313f" returned: 0 in 0.434s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Lock "cinder-quobyte-d6393664-ceed-4a82-a275-38af9235313f" released by "_copy_volume_from_snapshot" :: held 4.377s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Lock "cinder-quobyte-179fa9c3-f3cb-44f2-84c9-e54844205de0-d6393664-ceed-4a82-a275-38af9235313f" released by "_create_volume_from_snapshot" :: held 4.397s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.429s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.197s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1020962637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='990e76bea3b5471b8ea4aeaa9c902fdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:31Z,use_quota=True,user_id='8088ea50ab7a444b872d62cf6f480937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Creating volume 9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:38 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:38 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc 1073741824 Apr 21 21:01:38 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f83d00-15d3-4f22-a276-7e44642bf9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6393664-ceed-4a82-a275-38af9235313f', 'volume_size': 1, 'snapshot_id': '179fa9c3-f3cb-44f2-84c9-e54844205de0'}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928769be-d148-4e45-8d56-b51d7fe52355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:38 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Volume volume-d6393664-ceed-4a82-a275-38af9235313f (d6393664-ceed-4a82-a275-38af9235313f): created successfully Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928769be-d148-4e45-8d56-b51d7fe52355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Flow 'volume_create_manager' (35834d01-4a1f-4f5f-ba11-cc3904a12113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:38 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-ecd96348-407f-4e03-95dc-cf06246ed5a4 tempest-SnapshotDependencyTests-198707550 None] Created volume successfully. Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-243f6e19-f864-41be-8eb3-b61970615c92 tempest-SnapshotDependencyTests-198707550 None] Acquiring lock "cinder-179fa9c3-f3cb-44f2-84c9-e54844205de0-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-243f6e19-f864-41be-8eb3-b61970615c92 tempest-SnapshotDependencyTests-198707550 None] Lock "cinder-179fa9c3-f3cb-44f2-84c9-e54844205de0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-243f6e19-f864-41be-8eb3-b61970615c92 tempest-SnapshotDependencyTests-198707550 None] Acquiring lock "cinder-quobyte-aa21df73-27b0-4824-892a-143749024acd" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-243f6e19-f864-41be-8eb3-b61970615c92 tempest-SnapshotDependencyTests-198707550 None] Lock "cinder-quobyte-aa21df73-27b0-4824-892a-143749024acd" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-243f6e19-f864-41be-8eb3-b61970615c92 tempest-SnapshotDependencyTests-198707550 None] Acquiring lock "cinder-quobyte-179fa9c3-f3cb-44f2-84c9-e54844205de0" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-243f6e19-f864-41be-8eb3-b61970615c92 tempest-SnapshotDependencyTests-198707550 None] Lock "cinder-quobyte-179fa9c3-f3cb-44f2-84c9-e54844205de0" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-243f6e19-f864-41be-8eb3-b61970615c92 tempest-SnapshotDependencyTests-198707550 None] Deleting offline snapshot 179fa9c3-f3cb-44f2-84c9-e54844205de0 of volume aa21df73-27b0-4824-892a-143749024acd {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:01:38 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-243f6e19-f864-41be-8eb3-b61970615c92 tempest-SnapshotDependencyTests-198707550 None] snapshot_file for this snap is: volume-aa21df73-27b0-4824-892a-143749024acd.179fa9c3-f3cb-44f2-84c9-e54844205de0 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-30f19a4d-d4b3-4d9c-b0a1-eb667dc567dc tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.481s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-30f19a4d-d4b3-4d9c-b0a1-eb667dc567dc tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:38 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-30f19a4d-d4b3-4d9c-b0a1-eb667dc567dc tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Deleted volume successfully. Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[93965e92-f766-4d85-bb21-9c6b1a750a28]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-243f6e19-f864-41be-8eb3-b61970615c92 tempest-SnapshotDependencyTests-198707550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.179fa9c3-f3cb-44f2-84c9-e54844205de0 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-30f19a4d-d4b3-4d9c-b0a1-eb667dc567dc tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-8e71ad52-fa79-49d3-8436-b072ac08ade5-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:38 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.179fa9c3-f3cb-44f2-84c9-e54844205de0 Apr 21 21:01:38 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:38 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc 1073741824" returned: 0 in 0.563s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:38 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc Apr 21 21:01:38 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-418cadb2-9b70-488e-970d-159f7401911c tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "cinder-c6736285-2be0-4e2f-999a-1ef1b1af122a-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-418cadb2-9b70-488e-970d-159f7401911c tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-c6736285-2be0-4e2f-999a-1ef1b1af122a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-418cadb2-9b70-488e-970d-159f7401911c tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "cinder-quobyte-c6736285-2be0-4e2f-999a-1ef1b1af122a" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-418cadb2-9b70-488e-970d-159f7401911c tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-quobyte-c6736285-2be0-4e2f-999a-1ef1b1af122a" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[9083b6c6-9e3c-48de-a0be-e93ee849118b]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:38 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-418cadb2-9b70-488e-970d-159f7401911c tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c6736285-2be0-4e2f-999a-1ef1b1af122a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:38 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c6736285-2be0-4e2f-999a-1ef1b1af122a Apr 21 21:01:38 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:39 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-243f6e19-f864-41be-8eb3-b61970615c92 tempest-SnapshotDependencyTests-198707550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.179fa9c3-f3cb-44f2-84c9-e54844205de0" returned: 0 in 0.560s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-243f6e19-f864-41be-8eb3-b61970615c92 tempest-SnapshotDependencyTests-198707550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa21df73-27b0-4824-892a-143749024acd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6f48df-3e0b-44b5-a4ea-ac0ff52c4fb6]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-243f6e19-f864-41be-8eb3-b61970615c92 tempest-SnapshotDependencyTests-198707550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:39 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd Apr 21 21:01:39 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:39 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc" returned: 0 in 0.482s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.986s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b17daa838b49bf9ab20a515513a9ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:35Z,use_quota=True,user_id='92be3fe238ac480c85736aa94bfe8578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Creating volume 6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:39 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf2e2c1-9659-4715-99bf-1b9f38564210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea38705-4585-4e47-bba7-1cfb78081a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:39 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7 1073741824 Apr 21 21:01:39 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:39 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Volume volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc (9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc): created successfully Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea38705-4585-4e47-bba7-1cfb78081a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Flow 'volume_create_manager' (e25713b7-e76e-492d-a2a0-7fce461aba72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:39 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-016a67d1-3b1e-4814-87ed-f1f27c02cd00 tempest-VolumeDependencyTests-1493625113 None] Created volume successfully. Apr 21 21:01:39 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-418cadb2-9b70-488e-970d-159f7401911c tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c6736285-2be0-4e2f-999a-1ef1b1af122a" returned: 0 in 0.524s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-418cadb2-9b70-488e-970d-159f7401911c tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c6736285-2be0-4e2f-999a-1ef1b1af122a {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:39 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c6736285-2be0-4e2f-999a-1ef1b1af122a Apr 21 21:01:39 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:39 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-243f6e19-f864-41be-8eb3-b61970615c92 tempest-SnapshotDependencyTests-198707550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd" returned: 0 in 0.510s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-243f6e19-f864-41be-8eb3-b61970615c92 tempest-SnapshotDependencyTests-198707550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.179fa9c3-f3cb-44f2-84c9-e54844205de0 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:39 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.179fa9c3-f3cb-44f2-84c9-e54844205de0 Apr 21 21:01:39 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Flow 'volume_create_manager' (9060a41f-2b9a-45af-a8fc-0074f701d4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16904f4a-9a0e-4a97-9669-95b81909c447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:39 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16904f4a-9a0e-4a97-9669-95b81909c447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-99224336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=651de685-aa6c-4501-aaa6-a91e83b047f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='990e76bea3b5471b8ea4aeaa9c902fdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:40Z,use_quota=True,user_id='8088ea50ab7a444b872d62cf6f480937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460ea136-49e9-46aa-9909-9afa590704c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460ea136-49e9-46aa-9909-9afa590704c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65b1710-1a29-4f4c-95ac-edf9b2d7609f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65b1710-1a29-4f4c-95ac-edf9b2d7609f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '651de685-aa6c-4501-aaa6-a91e83b047f7', 'volume_name': 'volume-651de685-aa6c-4501-aaa6-a91e83b047f7', 'volume_size': 1, 'source_volid': '9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc', 'source_volstatus': 'available'}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a745dcc-d51d-4b40-b1e8-7f2f07bcf8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a745dcc-d51d-4b40-b1e8-7f2f07bcf8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c1a6a6-7ade-47cf-a21b-d8b236afc8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:39 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Volume 651de685-aa6c-4501-aaa6-a91e83b047f7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-651de685-aa6c-4501-aaa6-a91e83b047f7', 'volume_size': 1, 'source_volid': '9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc', 'source_volstatus': 'available'} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7 1073741824" returned: 0 in 0.652s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:39 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:39 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7 Apr 21 21:01:39 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-418cadb2-9b70-488e-970d-159f7401911c tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-c6736285-2be0-4e2f-999a-1ef1b1af122a" returned: 0 in 0.501s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:39 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-418cadb2-9b70-488e-970d-159f7401911c tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-quobyte-c6736285-2be0-4e2f-999a-1ef1b1af122a" released by "delete_volume" :: held 1.062s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-418cadb2-9b70-488e-970d-159f7401911c tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Created reservations ['929e2887-487d-467f-ab9c-1e772f99134f', '5d2cb82c-8847-488e-aae5-5489a279171f', '2a113c36-7847-4e9d-82c4-d934217856c2', '191ea563-8b28-4496-8663-4018c2efe5d4'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-418cadb2-9b70-488e-970d-159f7401911c tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-418cadb2-9b70-488e-970d-159f7401911c tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-418cadb2-9b70-488e-970d-159f7401911c tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-418cadb2-9b70-488e-970d-159f7401911c tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-418cadb2-9b70-488e-970d-159f7401911c tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-418cadb2-9b70-488e-970d-159f7401911c tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:40 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:40 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:40 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-243f6e19-f864-41be-8eb3-b61970615c92 tempest-SnapshotDependencyTests-198707550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.179fa9c3-f3cb-44f2-84c9-e54844205de0" returned: 0 in 0.547s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-243f6e19-f864-41be-8eb3-b61970615c92 tempest-SnapshotDependencyTests-198707550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.179fa9c3-f3cb-44f2-84c9-e54844205de0 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:40 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.179fa9c3-f3cb-44f2-84c9-e54844205de0 Apr 21 21:01:40 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:40 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7" returned: 0 in 0.441s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.449s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:40 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Cloning volume 9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc to volume 651de685-aa6c-4501-aaa6-a91e83b047f7 Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8739ceb1-f4ca-42e4-b86c-f8ac19f9704a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35b8218-eaf5-4a20-bf89-4d5742f4e607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:40 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Volume volume-6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7 (6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7): created successfully Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35b8218-eaf5-4a20-bf89-4d5742f4e607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Flow 'volume_create_manager' (29de5e0c-434a-4cce-ab5f-e4f52a3c6fa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:40 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-e6f49fd0-9995-4be4-be62-2e61ae6487e1 tempest-CinderUnicodeTest-44390450 None] Created volume successfully. Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Creating offline snapshot 81d1f255-b254-413a-9e79-848ab2ced751 of volume 9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0bb014-471c-4544-8933-d551f479b7c7]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:40 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-418cadb2-9b70-488e-970d-159f7401911c tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.402s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-418cadb2-9b70-488e-970d-159f7401911c tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:40 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-418cadb2-9b70-488e-970d-159f7401911c tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Deleted volume successfully. Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-418cadb2-9b70-488e-970d-159f7401911c tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-c6736285-2be0-4e2f-999a-1ef1b1af122a-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:40 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-243f6e19-f864-41be-8eb3-b61970615c92 tempest-SnapshotDependencyTests-198707550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd.179fa9c3-f3cb-44f2-84c9-e54844205de0" returned: 0 in 0.411s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-243f6e19-f864-41be-8eb3-b61970615c92 tempest-SnapshotDependencyTests-198707550 None] Lock "cinder-quobyte-179fa9c3-f3cb-44f2-84c9-e54844205de0" released by "_delete_snapshot" :: held 2.093s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-243f6e19-f864-41be-8eb3-b61970615c92 tempest-SnapshotDependencyTests-198707550 None] Lock "cinder-quobyte-aa21df73-27b0-4824-892a-143749024acd" released by "delete_snapshot" :: held 2.106s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:40 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc Apr 21 21:01:40 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-243f6e19-f864-41be-8eb3-b61970615c92 tempest-SnapshotDependencyTests-198707550 None] Created reservations ['79ec9724-c9e4-48b1-a823-64a8eaef727c', 'dc5ac20f-5266-418c-a271-03073ce25240', 'dc45f74f-d54d-48fa-b428-9d9d134605c6', '3478bf9c-f9fe-427e-b5a7-5c987468b40b'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:40 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-243f6e19-f864-41be-8eb3-b61970615c92 tempest-SnapshotDependencyTests-198707550 None] Delete snapshot completed successfully. Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-243f6e19-f864-41be-8eb3-b61970615c92 tempest-SnapshotDependencyTests-198707550 None] Lock "cinder-179fa9c3-f3cb-44f2-84c9-e54844205de0-delete_snapshot" released by "delete_snapshot" :: held 2.204s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.volume.flows.manager.create_volume [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81957) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Flow 'volume_create_manager' (9c4326e0-da99-4cf7-9f0c-28b76afa35d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1011d631-c7b1-4594-aedf-f5e7f45c5ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1011d631-c7b1-4594-aedf-f5e7f45c5ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1385440252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e09e44-5499-4f4a-8ed8-3df18eb08902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b17daa838b49bf9ab20a515513a9ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:41Z,use_quota=True,user_id='92be3fe238ac480c85736aa94bfe8578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e25c31-a4d5-456a-9c05-db8e69f9df50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e25c31-a4d5-456a-9c05-db8e69f9df50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112e05d8-6ab6-479c-837b-e25da8cf404b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112e05d8-6ab6-479c-837b-e25da8cf404b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71e09e44-5499-4f4a-8ed8-3df18eb08902', 'volume_name': 'volume-71e09e44-5499-4f4a-8ed8-3df18eb08902', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ab3541-abf1-4074-8976-6c05558272a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ab3541-abf1-4074-8976-6c05558272a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e310f58d-cc19-4be5-a523-809c2de3fa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:40 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Volume 71e09e44-5499-4f4a-8ed8-3df18eb08902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71e09e44-5499-4f4a-8ed8-3df18eb08902', 'volume_size': 1} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:40 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc" returned: 0 in 0.488s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:40 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.81d1f255-b254-413a-9e79-848ab2ced751 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:40 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.81d1f255-b254-413a-9e79-848ab2ced751 1G Apr 21 21:01:40 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:41 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bed10789-eec6-443e-89a2-060dbbbc2702 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "cinder-6b26ffb7-b3aa-4c14-b038-829bb1f46034-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:41 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bed10789-eec6-443e-89a2-060dbbbc2702 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-6b26ffb7-b3aa-4c14-b038-829bb1f46034-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:41 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bed10789-eec6-443e-89a2-060dbbbc2702 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "cinder-quobyte-6b26ffb7-b3aa-4c14-b038-829bb1f46034" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:41 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bed10789-eec6-443e-89a2-060dbbbc2702 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-quobyte-6b26ffb7-b3aa-4c14-b038-829bb1f46034" acquired by "delete_volume" :: waited 0.006s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:41 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfaef4c-2f89-4590-bb3d-e3ac6081ba86]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bed10789-eec6-443e-89a2-060dbbbc2702 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6b26ffb7-b3aa-4c14-b038-829bb1f46034 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:41 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6b26ffb7-b3aa-4c14-b038-829bb1f46034 Apr 21 21:01:41 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:41 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.81d1f255-b254-413a-9e79-848ab2ced751 1G" returned: 0 in 0.460s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.81d1f255-b254-413a-9e79-848ab2ced751 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:41 devstack sudo[90632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.81d1f255-b254-413a-9e79-848ab2ced751 Apr 21 21:01:41 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:41 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f9978b55-c49f-4343-a65b-ac9170b03d41 tempest-SnapshotDependencyTests-198707550 None] Acquiring lock "cinder-aa21df73-27b0-4824-892a-143749024acd-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:41 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f9978b55-c49f-4343-a65b-ac9170b03d41 tempest-SnapshotDependencyTests-198707550 None] Lock "cinder-aa21df73-27b0-4824-892a-143749024acd-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:41 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:41 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f9978b55-c49f-4343-a65b-ac9170b03d41 tempest-SnapshotDependencyTests-198707550 None] Acquiring lock "cinder-quobyte-aa21df73-27b0-4824-892a-143749024acd" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bed10789-eec6-443e-89a2-060dbbbc2702 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6b26ffb7-b3aa-4c14-b038-829bb1f46034" returned: 0 in 0.517s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bed10789-eec6-443e-89a2-060dbbbc2702 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6b26ffb7-b3aa-4c14-b038-829bb1f46034 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:41 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f9978b55-c49f-4343-a65b-ac9170b03d41 tempest-SnapshotDependencyTests-198707550 None] Lock "cinder-quobyte-aa21df73-27b0-4824-892a-143749024acd" acquired by "delete_volume" :: waited 0.016s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:41 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6b26ffb7-b3aa-4c14-b038-829bb1f46034 Apr 21 21:01:41 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:41 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c0b531-251a-4f94-bc1e-f377c2a48894]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f9978b55-c49f-4343-a65b-ac9170b03d41 tempest-SnapshotDependencyTests-198707550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:41 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd Apr 21 21:01:41 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:41 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.81d1f255-b254-413a-9e79-848ab2ced751" returned: 0 in 0.417s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:41 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.81d1f255-b254-413a-9e79-848ab2ced751 is being set with open permissions: ugo+rw Apr 21 21:01:41 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.81d1f255-b254-413a-9e79-848ab2ced751 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:41 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.81d1f255-b254-413a-9e79-848ab2ced751 Apr 21 21:01:41 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:42 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bed10789-eec6-443e-89a2-060dbbbc2702 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6b26ffb7-b3aa-4c14-b038-829bb1f46034" returned: 0 in 0.435s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bed10789-eec6-443e-89a2-060dbbbc2702 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-quobyte-6b26ffb7-b3aa-4c14-b038-829bb1f46034" released by "delete_volume" :: held 0.974s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-bed10789-eec6-443e-89a2-060dbbbc2702 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Created reservations ['2b3dc41d-7137-45ae-9d47-d7ae4ba12e8e', 'b9cc941d-c658-4523-962f-0e60f25ca869', '1af4a0f0-8268-4d27-b2d5-7e9aac95463a', '0efdcb9c-c78a-4782-b910-d26327a197db'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:42 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f9978b55-c49f-4343-a65b-ac9170b03d41 tempest-SnapshotDependencyTests-198707550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd" returned: 0 in 0.466s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f9978b55-c49f-4343-a65b-ac9170b03d41 tempest-SnapshotDependencyTests-198707550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:42 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd Apr 21 21:01:42 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-bed10789-eec6-443e-89a2-060dbbbc2702 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-bed10789-eec6-443e-89a2-060dbbbc2702 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-bed10789-eec6-443e-89a2-060dbbbc2702 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-bed10789-eec6-443e-89a2-060dbbbc2702 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-bed10789-eec6-443e-89a2-060dbbbc2702 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bed10789-eec6-443e-89a2-060dbbbc2702 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-47673a50-9b55-458e-b954-296d7eb5e7c8 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "cinder-2e6b5ac9-b903-4505-b6dc-018b8e14a1c9-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:42 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:42 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-47673a50-9b55-458e-b954-296d7eb5e7c8 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-2e6b5ac9-b903-4505-b6dc-018b8e14a1c9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-47673a50-9b55-458e-b954-296d7eb5e7c8 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "cinder-quobyte-2e6b5ac9-b903-4505-b6dc-018b8e14a1c9" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-47673a50-9b55-458e-b954-296d7eb5e7c8 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-quobyte-2e6b5ac9-b903-4505-b6dc-018b8e14a1c9" acquired by "delete_volume" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f6a19e-abe3-460a-a24c-c29b6e9bbe36]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-47673a50-9b55-458e-b954-296d7eb5e7c8 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2e6b5ac9-b903-4505-b6dc-018b8e14a1c9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:42 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.81d1f255-b254-413a-9e79-848ab2ced751" returned: 0 in 0.445s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:42 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.info Apr 21 21:01:42 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:42 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2e6b5ac9-b903-4505-b6dc-018b8e14a1c9 Apr 21 21:01:42 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:42 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f9978b55-c49f-4343-a65b-ac9170b03d41 tempest-SnapshotDependencyTests-198707550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-aa21df73-27b0-4824-892a-143749024acd" returned: 0 in 0.468s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f9978b55-c49f-4343-a65b-ac9170b03d41 tempest-SnapshotDependencyTests-198707550 None] Lock "cinder-quobyte-aa21df73-27b0-4824-892a-143749024acd" released by "delete_volume" :: held 0.961s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:42 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-bed10789-eec6-443e-89a2-060dbbbc2702 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.450s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-bed10789-eec6-443e-89a2-060dbbbc2702 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:42 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-bed10789-eec6-443e-89a2-060dbbbc2702 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Deleted volume successfully. Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-bed10789-eec6-443e-89a2-060dbbbc2702 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-6b26ffb7-b3aa-4c14-b038-829bb1f46034-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-f9978b55-c49f-4343-a65b-ac9170b03d41 tempest-SnapshotDependencyTests-198707550 None] Created reservations ['453a47d8-90f5-4c59-8f85-113eafce184e', '0547a700-e4ec-4c53-bf8f-34704ed2ff1a', '525c820c-56d2-4e24-8476-36e787aca85c', '9a7659aa-6e6a-432e-be5a-efa6c1aa88c3'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f9978b55-c49f-4343-a65b-ac9170b03d41 tempest-SnapshotDependencyTests-198707550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f9978b55-c49f-4343-a65b-ac9170b03d41 tempest-SnapshotDependencyTests-198707550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f9978b55-c49f-4343-a65b-ac9170b03d41 tempest-SnapshotDependencyTests-198707550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f9978b55-c49f-4343-a65b-ac9170b03d41 tempest-SnapshotDependencyTests-198707550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f9978b55-c49f-4343-a65b-ac9170b03d41 tempest-SnapshotDependencyTests-198707550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f9978b55-c49f-4343-a65b-ac9170b03d41 tempest-SnapshotDependencyTests-198707550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:42 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.info" returned: 0 in 0.424s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:42 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.info is being set with open permissions: ugo+rw Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:42 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:42 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:42 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.info Apr 21 21:01:42 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:42 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-47673a50-9b55-458e-b954-296d7eb5e7c8 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2e6b5ac9-b903-4505-b6dc-018b8e14a1c9" returned: 0 in 0.562s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:42 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-47673a50-9b55-458e-b954-296d7eb5e7c8 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2e6b5ac9-b903-4505-b6dc-018b8e14a1c9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:42 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2e6b5ac9-b903-4505-b6dc-018b8e14a1c9 Apr 21 21:01:42 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:43 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f9978b55-c49f-4343-a65b-ac9170b03d41 tempest-SnapshotDependencyTests-198707550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.425s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-f9978b55-c49f-4343-a65b-ac9170b03d41 tempest-SnapshotDependencyTests-198707550 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:43 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-f9978b55-c49f-4343-a65b-ac9170b03d41 tempest-SnapshotDependencyTests-198707550 None] Deleted volume successfully. Apr 21 21:01:43 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.info" returned: 0 in 0.423s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "cinder-quobyte-651de685-aa6c-4501-aaa6-a91e83b047f7" by "_copy_volume_from_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f9978b55-c49f-4343-a65b-ac9170b03d41 tempest-SnapshotDependencyTests-198707550 None] Lock "cinder-aa21df73-27b0-4824-892a-143749024acd-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-quobyte-651de685-aa6c-4501-aaa6-a91e83b047f7" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] snapshot: 81d1f255-b254-413a-9e79-848ab2ced751, volume: 651de685-aa6c-4501-aaa6-a91e83b047f7, {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc9bdcb-312c-4398-929b-8b16ae41aced]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.81d1f255-b254-413a-9e79-848ab2ced751 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:43 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-47673a50-9b55-458e-b954-296d7eb5e7c8 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-2e6b5ac9-b903-4505-b6dc-018b8e14a1c9" returned: 0 in 0.433s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:43 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.81d1f255-b254-413a-9e79-848ab2ced751 Apr 21 21:01:43 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-47673a50-9b55-458e-b954-296d7eb5e7c8 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-quobyte-2e6b5ac9-b903-4505-b6dc-018b8e14a1c9" released by "delete_volume" :: held 1.023s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-47673a50-9b55-458e-b954-296d7eb5e7c8 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Created reservations ['b0a55883-7104-4eca-82a0-f8d804fad769', '991d7d4c-500f-4a23-8143-c0b8ace06490', 'ef1e2045-28bd-4106-b406-c76a768fbd3f', '8ae4a2e2-c84b-4b40-9ab5-aa80ba92fb4b'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-47673a50-9b55-458e-b954-296d7eb5e7c8 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-47673a50-9b55-458e-b954-296d7eb5e7c8 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-47673a50-9b55-458e-b954-296d7eb5e7c8 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-47673a50-9b55-458e-b954-296d7eb5e7c8 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-47673a50-9b55-458e-b954-296d7eb5e7c8 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-47673a50-9b55-458e-b954-296d7eb5e7c8 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:43 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:43 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:43 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.81d1f255-b254-413a-9e79-848ab2ced751" returned: 0 in 0.472s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Creating direct copy from snapshot {{(pid=81957) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97838b7-8a03-4fa0-b9c7-f6ff77954b15]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f8d69070-0208-43c6-82c7-213b84d7c610 tempest-SnapshotDependencyTests-198707550 None] Acquiring lock "cinder-d6393664-ceed-4a82-a275-38af9235313f-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:43 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:43 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc Apr 21 21:01:43 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-47673a50-9b55-458e-b954-296d7eb5e7c8 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.429s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-47673a50-9b55-458e-b954-296d7eb5e7c8 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f8d69070-0208-43c6-82c7-213b84d7c610 tempest-SnapshotDependencyTests-198707550 None] Lock "cinder-d6393664-ceed-4a82-a275-38af9235313f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:43 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-47673a50-9b55-458e-b954-296d7eb5e7c8 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Deleted volume successfully. Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-47673a50-9b55-458e-b954-296d7eb5e7c8 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-2e6b5ac9-b903-4505-b6dc-018b8e14a1c9-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f8d69070-0208-43c6-82c7-213b84d7c610 tempest-SnapshotDependencyTests-198707550 None] Acquiring lock "cinder-quobyte-d6393664-ceed-4a82-a275-38af9235313f" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f8d69070-0208-43c6-82c7-213b84d7c610 tempest-SnapshotDependencyTests-198707550 None] Lock "cinder-quobyte-d6393664-ceed-4a82-a275-38af9235313f" acquired by "delete_volume" :: waited 0.008s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[287b0a75-c1c3-425c-9312-4ee883638a8c]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f8d69070-0208-43c6-82c7-213b84d7c610 tempest-SnapshotDependencyTests-198707550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d6393664-ceed-4a82-a275-38af9235313f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:43 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d6393664-ceed-4a82-a275-38af9235313f Apr 21 21:01:43 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:44 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc" returned: 0 in 0.535s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:44 devstack cinder-volume[81957]: DEBUG cinder.utils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Path /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-651de685-aa6c-4501-aaa6-a91e83b047f7 not found in is_blk_device check {{(pid=81957) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 21:01:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-651de685-aa6c-4501-aaa6-a91e83b047f7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:44 devstack sudo[90689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-651de685-aa6c-4501-aaa6-a91e83b047f7 Apr 21 21:01:44 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:44 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f8d69070-0208-43c6-82c7-213b84d7c610 tempest-SnapshotDependencyTests-198707550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d6393664-ceed-4a82-a275-38af9235313f" returned: 0 in 0.475s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f8d69070-0208-43c6-82c7-213b84d7c610 tempest-SnapshotDependencyTests-198707550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d6393664-ceed-4a82-a275-38af9235313f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:44 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d6393664-ceed-4a82-a275-38af9235313f Apr 21 21:01:44 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:44 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a5046ca2-f193-4a47-8e71-67632a4265d0 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "cinder-8f3f4361-73a8-4a80-beac-b4051d6c6ed9-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:44 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a5046ca2-f193-4a47-8e71-67632a4265d0 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-8f3f4361-73a8-4a80-beac-b4051d6c6ed9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:44 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a5046ca2-f193-4a47-8e71-67632a4265d0 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "cinder-quobyte-8f3f4361-73a8-4a80-beac-b4051d6c6ed9" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:44 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a5046ca2-f193-4a47-8e71-67632a4265d0 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-quobyte-8f3f4361-73a8-4a80-beac-b4051d6c6ed9" acquired by "delete_volume" :: waited 0.021s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:44 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35821fc-4d39-4977-99c2-0ffba9de30ff]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a5046ca2-f193-4a47-8e71-67632a4265d0 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8f3f4361-73a8-4a80-beac-b4051d6c6ed9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:44 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8f3f4361-73a8-4a80-beac-b4051d6c6ed9 Apr 21 21:01:44 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:44 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:44 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f8d69070-0208-43c6-82c7-213b84d7c610 tempest-SnapshotDependencyTests-198707550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d6393664-ceed-4a82-a275-38af9235313f" returned: 0 in 0.673s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:44 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f8d69070-0208-43c6-82c7-213b84d7c610 tempest-SnapshotDependencyTests-198707550 None] Lock "cinder-quobyte-d6393664-ceed-4a82-a275-38af9235313f" released by "delete_volume" :: held 1.175s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:45 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-f8d69070-0208-43c6-82c7-213b84d7c610 tempest-SnapshotDependencyTests-198707550 None] Created reservations ['97ebda75-1cf4-4bef-bb10-c924b77ff452', 'e55d2bc0-3e08-4752-8c3b-d0a8383f3640', 'f5958728-3daa-4064-a119-f37473ac10b8', 'c958ff42-a391-4764-b6a9-11236f71c6aa'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f8d69070-0208-43c6-82c7-213b84d7c610 tempest-SnapshotDependencyTests-198707550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f8d69070-0208-43c6-82c7-213b84d7c610 tempest-SnapshotDependencyTests-198707550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:45 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f8d69070-0208-43c6-82c7-213b84d7c610 tempest-SnapshotDependencyTests-198707550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:45 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-f8d69070-0208-43c6-82c7-213b84d7c610 tempest-SnapshotDependencyTests-198707550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-f8d69070-0208-43c6-82c7-213b84d7c610 tempest-SnapshotDependencyTests-198707550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f8d69070-0208-43c6-82c7-213b84d7c610 tempest-SnapshotDependencyTests-198707550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:45 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:45 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:45 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a5046ca2-f193-4a47-8e71-67632a4265d0 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8f3f4361-73a8-4a80-beac-b4051d6c6ed9" returned: 0 in 1.065s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a5046ca2-f193-4a47-8e71-67632a4265d0 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8f3f4361-73a8-4a80-beac-b4051d6c6ed9 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:45 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8f3f4361-73a8-4a80-beac-b4051d6c6ed9 Apr 21 21:01:45 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:45 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:45 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-f8d69070-0208-43c6-82c7-213b84d7c610 tempest-SnapshotDependencyTests-198707550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.800s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:45 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-f8d69070-0208-43c6-82c7-213b84d7c610 tempest-SnapshotDependencyTests-198707550 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:45 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-f8d69070-0208-43c6-82c7-213b84d7c610 tempest-SnapshotDependencyTests-198707550 None] Deleted volume successfully. Apr 21 21:01:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-f8d69070-0208-43c6-82c7-213b84d7c610 tempest-SnapshotDependencyTests-198707550 None] Lock "cinder-d6393664-ceed-4a82-a275-38af9235313f-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:46 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a5046ca2-f193-4a47-8e71-67632a4265d0 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-8f3f4361-73a8-4a80-beac-b4051d6c6ed9" returned: 0 in 0.957s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:46 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a5046ca2-f193-4a47-8e71-67632a4265d0 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-quobyte-8f3f4361-73a8-4a80-beac-b4051d6c6ed9" released by "delete_volume" :: held 2.042s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:46 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-a5046ca2-f193-4a47-8e71-67632a4265d0 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Created reservations ['cbd65a28-5b3a-4a40-8066-1cbe9234119c', 'c64be4cf-fe33-4141-947d-f829d88012ee', 'ecc1a6fc-559a-4e60-8f30-5852e3ab3932', '0c89fb40-c913-45a7-b0f1-b597e3e0cfdb'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:46 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-651de685-aa6c-4501-aaa6-a91e83b047f7" returned: 0 in 2.288s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:46 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c8c891-87e7-4107-a4ca-99aa8a2b5af6]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a5046ca2-f193-4a47-8e71-67632a4265d0 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a5046ca2-f193-4a47-8e71-67632a4265d0 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a5046ca2-f193-4a47-8e71-67632a4265d0 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:46 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a5046ca2-f193-4a47-8e71-67632a4265d0 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a5046ca2-f193-4a47-8e71-67632a4265d0 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:46 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a5046ca2-f193-4a47-8e71-67632a4265d0 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:46 devstack sudo[90719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:46 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:46 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc Apr 21 21:01:46 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:47 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a5046ca2-f193-4a47-8e71-67632a4265d0 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.536s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:47 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-a5046ca2-f193-4a47-8e71-67632a4265d0 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:47 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-a5046ca2-f193-4a47-8e71-67632a4265d0 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Deleted volume successfully. Apr 21 21:01:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a5046ca2-f193-4a47-8e71-67632a4265d0 tempest-CreateVolumesFromSourceVolumeTest-843642591 None] Lock "cinder-8f3f4361-73a8-4a80-beac-b4051d6c6ed9-delete_volume" released by "delete_volume" :: held 2.749s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:47 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc" returned: 0 in 0.747s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:47 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc, size 1024.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-651de685-aa6c-4501-aaa6-a91e83b047f7 {{(pid=81957) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 21:01:47 devstack cinder-volume[81957]: INFO cinder.image.image_utils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Converted 1024.00 MB image at 447.49 MB/s Apr 21 21:01:47 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-651de685-aa6c-4501-aaa6-a91e83b047f7 is being set with open permissions: ugo+rw Apr 21 21:01:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-651de685-aa6c-4501-aaa6-a91e83b047f7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:47 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-651de685-aa6c-4501-aaa6-a91e83b047f7 Apr 21 21:01:47 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:47 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-651de685-aa6c-4501-aaa6-a91e83b047f7" returned: 0 in 0.499s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-quobyte-651de685-aa6c-4501-aaa6-a91e83b047f7" released by "_copy_volume_from_snapshot" :: held 4.590s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "cinder-quobyte-81d1f255-b254-413a-9e79-848ab2ced751" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:47 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-quobyte-81d1f255-b254-413a-9e79-848ab2ced751" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Deleting offline snapshot 81d1f255-b254-413a-9e79-848ab2ced751 of volume 9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:01:47 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] snapshot_file for this snap is: volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.81d1f255-b254-413a-9e79-848ab2ced751 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:01:47 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[125af956-0ce7-491d-b1b2-6a8ccb96b667]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:47 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.81d1f255-b254-413a-9e79-848ab2ced751 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:47 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.81d1f255-b254-413a-9e79-848ab2ced751 Apr 21 21:01:47 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:48 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.81d1f255-b254-413a-9e79-848ab2ced751" returned: 0 in 0.522s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:48 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:01:48 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[5583c931-57f4-4d48-b86f-13d7b4052913]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:48 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc Apr 21 21:01:48 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:48 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc" returned: 0 in 0.534s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:48 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.81d1f255-b254-413a-9e79-848ab2ced751 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:48 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.81d1f255-b254-413a-9e79-848ab2ced751 Apr 21 21:01:48 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:49 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.81d1f255-b254-413a-9e79-848ab2ced751" returned: 0 in 0.493s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.81d1f255-b254-413a-9e79-848ab2ced751 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:49 devstack sudo[90747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.81d1f255-b254-413a-9e79-848ab2ced751 Apr 21 21:01:49 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:49 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc.81d1f255-b254-413a-9e79-848ab2ced751" returned: 0 in 0.501s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:49 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-quobyte-81d1f255-b254-413a-9e79-848ab2ced751" released by "_delete_snapshot" :: held 2.100s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.492s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.944s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:49 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1385440252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e09e44-5499-4f4a-8ed8-3df18eb08902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b17daa838b49bf9ab20a515513a9ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:41Z,use_quota=True,user_id='92be3fe238ac480c85736aa94bfe8578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e2b8b4f-909a-4033-9c8c-33891b085b3b),volume_type_id=8e2b8b4f-909a-4033-9c8c-33891b085b3b)}" {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:49 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Creating volume 71e09e44-5499-4f4a-8ed8-3df18eb08902 {{(pid=81957) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:49 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:49 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:49 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Selected osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 as target Quobyte volume. {{(pid=81957) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:49 devstack cinder-volume[81957]: INFO cinder.volume.drivers.remotefs [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] casted to osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7 Apr 21 21:01:49 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902 1073741824 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:49 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c1a6a6-7ade-47cf-a21b-d8b236afc8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-651de685-aa6c-4501-aaa6-a91e83b047f7', 'volume_size': 1, 'source_volid': '9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc', 'source_volstatus': 'available'}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:49 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902 1073741824 Apr 21 21:01:49 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8055d8c-5921-4e94-bf97-954295c7bc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:49 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:49 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Volume volume-651de685-aa6c-4501-aaa6-a91e83b047f7 (651de685-aa6c-4501-aaa6-a91e83b047f7): created successfully Apr 21 21:01:49 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8055d8c-5921-4e94-bf97-954295c7bc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:49 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Flow 'volume_create_manager' (9060a41f-2b9a-45af-a8fc-0074f701d4d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:49 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-5afb1fe0-fb6c-42aa-9e84-f12b290ab7ad tempest-VolumeDependencyTests-1493625113 None] Created volume successfully. Apr 21 21:01:50 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902 1073741824" returned: 0 in 0.544s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:50 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902 Apr 21 21:01:50 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:50 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-4e84f833-bbc6-4f35-af09-db0f627ba1f3 tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "cinder-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:50 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-4e84f833-bbc6-4f35-af09-db0f627ba1f3 tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:50 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-4e84f833-bbc6-4f35-af09-db0f627ba1f3 tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "cinder-quobyte-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:50 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-4e84f833-bbc6-4f35-af09-db0f627ba1f3 tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-quobyte-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc" acquired by "delete_volume" :: waited 0.007s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:50 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b26c2e-a902-406f-a4ca-cbc826b26b93]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4e84f833-bbc6-4f35-af09-db0f627ba1f3 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:50 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc Apr 21 21:01:50 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:50 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902" returned: 0 in 0.494s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:50 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'} {{(pid=81957) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:50 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:50 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e310f58d-cc19-4be5-a523-809c2de3fa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71e09e44-5499-4f4a-8ed8-3df18eb08902', 'volume_size': 1}' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:50 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582a383c-eb78-4fd3-bcfc-c5cabf83d8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:50 devstack cinder-volume[81957]: INFO cinder.volume.flows.manager.create_volume [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Volume volume-71e09e44-5499-4f4a-8ed8-3df18eb08902 (71e09e44-5499-4f4a-8ed8-3df18eb08902): created successfully Apr 21 21:01:50 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582a383c-eb78-4fd3-bcfc-c5cabf83d8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81957) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:50 devstack cinder-volume[81957]: DEBUG cinder.volume.manager [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Flow 'volume_create_manager' (9c4326e0-da99-4cf7-9f0c-28b76afa35d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81957) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:50 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-98064b2d-d4fc-4ced-9cbd-c1cf3b51cbe1 tempest-CinderUnicodeTest-44390450 None] Created volume successfully. Apr 21 21:01:51 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4e84f833-bbc6-4f35-af09-db0f627ba1f3 tempest-VolumeDependencyTests-1493625113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc" returned: 0 in 0.533s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4e84f833-bbc6-4f35-af09-db0f627ba1f3 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:51 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc Apr 21 21:01:51 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:51 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4e84f833-bbc6-4f35-af09-db0f627ba1f3 tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc" returned: 0 in 0.469s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:51 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-4e84f833-bbc6-4f35-af09-db0f627ba1f3 tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-quobyte-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc" released by "delete_volume" :: held 1.044s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:51 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-4e84f833-bbc6-4f35-af09-db0f627ba1f3 tempest-VolumeDependencyTests-1493625113 None] Created reservations ['445611d4-3e3c-406f-9243-4cad38fb04b9', '0ab01e01-5a9f-444a-8e39-a2923eea0d4f', '263ea312-dde6-4de4-bf18-ef456dad5196', '3b943e33-0ad1-4560-9e8d-9bced5e16465'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4e84f833-bbc6-4f35-af09-db0f627ba1f3 tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4e84f833-bbc6-4f35-af09-db0f627ba1f3 tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:51 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-4e84f833-bbc6-4f35-af09-db0f627ba1f3 tempest-VolumeDependencyTests-1493625113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:51 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-4e84f833-bbc6-4f35-af09-db0f627ba1f3 tempest-VolumeDependencyTests-1493625113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-4e84f833-bbc6-4f35-af09-db0f627ba1f3 tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4e84f833-bbc6-4f35-af09-db0f627ba1f3 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:51 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:51 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2f78f1b8-3b10-4799-b486-a0c93bf4888a tempest-CinderUnicodeTest-44390450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2f78f1b8-3b10-4799-b486-a0c93bf4888a tempest-CinderUnicodeTest-44390450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:51 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-2f78f1b8-3b10-4799-b486-a0c93bf4888a tempest-CinderUnicodeTest-44390450 None] Creating offline snapshot a9412466-b7ef-4e35-bd51-acecff42ad1f of volume 71e09e44-5499-4f4a-8ed8-3df18eb08902 {{(pid=81957) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:01:51 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ff5090-89e1-4684-8a62-9e3a04b40cfe]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:51 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2f78f1b8-3b10-4799-b486-a0c93bf4888a tempest-CinderUnicodeTest-44390450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:51 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902 Apr 21 21:01:51 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:52 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-4e84f833-bbc6-4f35-af09-db0f627ba1f3 tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.489s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:52 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-4e84f833-bbc6-4f35-af09-db0f627ba1f3 tempest-VolumeDependencyTests-1493625113 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:52 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-4e84f833-bbc6-4f35-af09-db0f627ba1f3 tempest-VolumeDependencyTests-1493625113 None] Deleted volume successfully. Apr 21 21:01:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-4e84f833-bbc6-4f35-af09-db0f627ba1f3 tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-9dd9feeb-22f8-42a7-9145-81ec2b4ac3cc-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:52 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2f78f1b8-3b10-4799-b486-a0c93bf4888a tempest-CinderUnicodeTest-44390450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902" returned: 0 in 0.516s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2f78f1b8-3b10-4799-b486-a0c93bf4888a tempest-CinderUnicodeTest-44390450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.a9412466-b7ef-4e35-bd51-acecff42ad1f 1G {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:52 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.a9412466-b7ef-4e35-bd51-acecff42ad1f 1G Apr 21 21:01:52 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a6d623f5-d700-4d42-b6f8-352871c71cd1 tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "cinder-651de685-aa6c-4501-aaa6-a91e83b047f7-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a6d623f5-d700-4d42-b6f8-352871c71cd1 tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-651de685-aa6c-4501-aaa6-a91e83b047f7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:52 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a6d623f5-d700-4d42-b6f8-352871c71cd1 tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "cinder-quobyte-651de685-aa6c-4501-aaa6-a91e83b047f7" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2f78f1b8-3b10-4799-b486-a0c93bf4888a tempest-CinderUnicodeTest-44390450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.a9412466-b7ef-4e35-bd51-acecff42ad1f 1G" returned: 0 in 0.486s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2f78f1b8-3b10-4799-b486-a0c93bf4888a tempest-CinderUnicodeTest-44390450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71e09e44-5499-4f4a-8ed8-3df18eb08902 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.a9412466-b7ef-4e35-bd51-acecff42ad1f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:52 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a6d623f5-d700-4d42-b6f8-352871c71cd1 tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-quobyte-651de685-aa6c-4501-aaa6-a91e83b047f7" acquired by "delete_volume" :: waited 0.019s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:52 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71e09e44-5499-4f4a-8ed8-3df18eb08902 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.a9412466-b7ef-4e35-bd51-acecff42ad1f Apr 21 21:01:52 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:52 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[03322c92-a6e7-4c9e-ada2-3db67ee48c3b]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:52 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a6d623f5-d700-4d42-b6f8-352871c71cd1 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-651de685-aa6c-4501-aaa6-a91e83b047f7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:52 devstack sudo[90784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-651de685-aa6c-4501-aaa6-a91e83b047f7 Apr 21 21:01:52 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:53 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2f78f1b8-3b10-4799-b486-a0c93bf4888a tempest-CinderUnicodeTest-44390450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71e09e44-5499-4f4a-8ed8-3df18eb08902 -F qcow2 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.a9412466-b7ef-4e35-bd51-acecff42ad1f" returned: 0 in 0.397s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:53 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-2f78f1b8-3b10-4799-b486-a0c93bf4888a tempest-CinderUnicodeTest-44390450 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.a9412466-b7ef-4e35-bd51-acecff42ad1f is being set with open permissions: ugo+rw Apr 21 21:01:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2f78f1b8-3b10-4799-b486-a0c93bf4888a tempest-CinderUnicodeTest-44390450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.a9412466-b7ef-4e35-bd51-acecff42ad1f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:53 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.a9412466-b7ef-4e35-bd51-acecff42ad1f Apr 21 21:01:53 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:53 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a6d623f5-d700-4d42-b6f8-352871c71cd1 tempest-VolumeDependencyTests-1493625113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-651de685-aa6c-4501-aaa6-a91e83b047f7" returned: 0 in 0.458s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a6d623f5-d700-4d42-b6f8-352871c71cd1 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-651de685-aa6c-4501-aaa6-a91e83b047f7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:53 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-651de685-aa6c-4501-aaa6-a91e83b047f7 Apr 21 21:01:53 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:53 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2f78f1b8-3b10-4799-b486-a0c93bf4888a tempest-CinderUnicodeTest-44390450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.a9412466-b7ef-4e35-bd51-acecff42ad1f" returned: 0 in 0.394s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2f78f1b8-3b10-4799-b486-a0c93bf4888a tempest-CinderUnicodeTest-44390450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:53 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.info Apr 21 21:01:53 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:53 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a6d623f5-d700-4d42-b6f8-352871c71cd1 tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-651de685-aa6c-4501-aaa6-a91e83b047f7" returned: 0 in 0.396s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:53 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a6d623f5-d700-4d42-b6f8-352871c71cd1 tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-quobyte-651de685-aa6c-4501-aaa6-a91e83b047f7" released by "delete_volume" :: held 0.876s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:53 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-a6d623f5-d700-4d42-b6f8-352871c71cd1 tempest-VolumeDependencyTests-1493625113 None] Created reservations ['01bff094-ffe8-46ac-a0a4-c50004670064', '60316e49-84bb-4535-b200-bed518b28af2', 'd399a651-302e-4d64-9ad0-f6b228b64cae', 'a5114471-1bb5-42b8-9070-04e9eb60bfc4'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:53 devstack cinder-volume[81957]: DEBUG oslo_service.periodic_task [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81957) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 21:01:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:53 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:53 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a6d623f5-d700-4d42-b6f8-352871c71cd1 tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a6d623f5-d700-4d42-b6f8-352871c71cd1 tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a6d623f5-d700-4d42-b6f8-352871c71cd1 tempest-VolumeDependencyTests-1493625113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:53 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-a6d623f5-d700-4d42-b6f8-352871c71cd1 tempest-VolumeDependencyTests-1493625113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-a6d623f5-d700-4d42-b6f8-352871c71cd1 tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:53 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a6d623f5-d700-4d42-b6f8-352871c71cd1 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:53 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:53 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:54 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c9f35848-f185-4aaf-bb8e-dab56534c921 tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "cinder-d805bda0-a8b8-4433-b9ae-5fe5cca2912d-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:54 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c9f35848-f185-4aaf-bb8e-dab56534c921 tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-d805bda0-a8b8-4433-b9ae-5fe5cca2912d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:54 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c9f35848-f185-4aaf-bb8e-dab56534c921 tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "cinder-quobyte-d805bda0-a8b8-4433-b9ae-5fe5cca2912d" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:54 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c9f35848-f185-4aaf-bb8e-dab56534c921 tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-quobyte-d805bda0-a8b8-4433-b9ae-5fe5cca2912d" acquired by "delete_volume" :: waited 0.006s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:54 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6647783-d6eb-4e36-b887-d85fad52776c]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c9f35848-f185-4aaf-bb8e-dab56534c921 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d805bda0-a8b8-4433-b9ae-5fe5cca2912d {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:54 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d805bda0-a8b8-4433-b9ae-5fe5cca2912d Apr 21 21:01:54 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:54 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2f78f1b8-3b10-4799-b486-a0c93bf4888a tempest-CinderUnicodeTest-44390450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.info" returned: 0 in 0.464s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:54 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.remotefs [None req-2f78f1b8-3b10-4799-b486-a0c93bf4888a tempest-CinderUnicodeTest-44390450 None] /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.info is being set with open permissions: ugo+rw Apr 21 21:01:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2f78f1b8-3b10-4799-b486-a0c93bf4888a tempest-CinderUnicodeTest-44390450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.info {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:54 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.info Apr 21 21:01:54 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:54 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.435s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:54 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-651fc9c8-b33b-4fcd-9ffd-f9671584df08 None None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:54 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-a6d623f5-d700-4d42-b6f8-352871c71cd1 tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.469s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:54 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-a6d623f5-d700-4d42-b6f8-352871c71cd1 tempest-VolumeDependencyTests-1493625113 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:54 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-a6d623f5-d700-4d42-b6f8-352871c71cd1 tempest-VolumeDependencyTests-1493625113 None] Deleted volume successfully. Apr 21 21:01:54 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-a6d623f5-d700-4d42-b6f8-352871c71cd1 tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-651de685-aa6c-4501-aaa6-a91e83b047f7-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:54 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c9f35848-f185-4aaf-bb8e-dab56534c921 tempest-VolumeDependencyTests-1493625113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d805bda0-a8b8-4433-b9ae-5fe5cca2912d" returned: 0 in 0.471s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c9f35848-f185-4aaf-bb8e-dab56534c921 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d805bda0-a8b8-4433-b9ae-5fe5cca2912d {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:54 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d805bda0-a8b8-4433-b9ae-5fe5cca2912d Apr 21 21:01:54 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:54 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-2f78f1b8-3b10-4799-b486-a0c93bf4888a tempest-CinderUnicodeTest-44390450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.info" returned: 0 in 0.405s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-2f78f1b8-3b10-4799-b486-a0c93bf4888a tempest-CinderUnicodeTest-44390450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.714s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:54 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-2f78f1b8-3b10-4799-b486-a0c93bf4888a tempest-CinderUnicodeTest-44390450 None] Create snapshot completed successfully Apr 21 21:01:54 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:54 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c9f35848-f185-4aaf-bb8e-dab56534c921 tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-d805bda0-a8b8-4433-b9ae-5fe5cca2912d" returned: 0 in 0.388s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:54 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c9f35848-f185-4aaf-bb8e-dab56534c921 tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-quobyte-d805bda0-a8b8-4433-b9ae-5fe5cca2912d" released by "delete_volume" :: held 0.882s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:54 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-c9f35848-f185-4aaf-bb8e-dab56534c921 tempest-VolumeDependencyTests-1493625113 None] Created reservations ['63ff0524-4b19-43ee-ba8f-cc6735c2af42', '274593d1-fb1e-408a-88e8-d9cd8bf14fd6', '6e6bc293-e097-4f09-b994-d2f690916609', 'c5310b23-083e-453d-8193-187573661702'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:54 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1b6259a9-e4f5-4d15-afca-bf3e9ee525de tempest-CinderUnicodeTest-44390450 None] Acquiring lock "cinder-a9412466-b7ef-4e35-bd51-acecff42ad1f-delete_snapshot" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:55 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1b6259a9-e4f5-4d15-afca-bf3e9ee525de tempest-CinderUnicodeTest-44390450 None] Lock "cinder-a9412466-b7ef-4e35-bd51-acecff42ad1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:55 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1b6259a9-e4f5-4d15-afca-bf3e9ee525de tempest-CinderUnicodeTest-44390450 None] Acquiring lock "cinder-quobyte-71e09e44-5499-4f4a-8ed8-3df18eb08902" by "delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:55 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1b6259a9-e4f5-4d15-afca-bf3e9ee525de tempest-CinderUnicodeTest-44390450 None] Lock "cinder-quobyte-71e09e44-5499-4f4a-8ed8-3df18eb08902" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:55 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1b6259a9-e4f5-4d15-afca-bf3e9ee525de tempest-CinderUnicodeTest-44390450 None] Acquiring lock "cinder-quobyte-a9412466-b7ef-4e35-bd51-acecff42ad1f" by "_delete_snapshot" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:55 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1b6259a9-e4f5-4d15-afca-bf3e9ee525de tempest-CinderUnicodeTest-44390450 None] Lock "cinder-quobyte-a9412466-b7ef-4e35-bd51-acecff42ad1f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-1b6259a9-e4f5-4d15-afca-bf3e9ee525de tempest-CinderUnicodeTest-44390450 None] Deleting offline snapshot a9412466-b7ef-4e35-bd51-acecff42ad1f of volume 71e09e44-5499-4f4a-8ed8-3df18eb08902 {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:01:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-1b6259a9-e4f5-4d15-afca-bf3e9ee525de tempest-CinderUnicodeTest-44390450 None] snapshot_file for this snap is: volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.a9412466-b7ef-4e35-bd51-acecff42ad1f {{(pid=81957) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:01:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c9f35848-f185-4aaf-bb8e-dab56534c921 tempest-VolumeDependencyTests-1493625113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c9f35848-f185-4aaf-bb8e-dab56534c921 tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c9f35848-f185-4aaf-bb8e-dab56534c921 tempest-VolumeDependencyTests-1493625113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-c9f35848-f185-4aaf-bb8e-dab56534c921 tempest-VolumeDependencyTests-1493625113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-c9f35848-f185-4aaf-bb8e-dab56534c921 tempest-VolumeDependencyTests-1493625113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c9f35848-f185-4aaf-bb8e-dab56534c921 tempest-VolumeDependencyTests-1493625113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:55 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[e115a7fa-d715-4860-b8dc-068f79a067d9]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1b6259a9-e4f5-4d15-afca-bf3e9ee525de tempest-CinderUnicodeTest-44390450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.a9412466-b7ef-4e35-bd51-acecff42ad1f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:55 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:55 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:55 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.a9412466-b7ef-4e35-bd51-acecff42ad1f Apr 21 21:01:55 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:55 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-c9f35848-f185-4aaf-bb8e-dab56534c921 tempest-VolumeDependencyTests-1493625113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.430s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:55 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-c9f35848-f185-4aaf-bb8e-dab56534c921 tempest-VolumeDependencyTests-1493625113 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:55 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-c9f35848-f185-4aaf-bb8e-dab56534c921 tempest-VolumeDependencyTests-1493625113 None] Deleted volume successfully. Apr 21 21:01:55 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-c9f35848-f185-4aaf-bb8e-dab56534c921 tempest-VolumeDependencyTests-1493625113 None] Lock "cinder-d805bda0-a8b8-4433-b9ae-5fe5cca2912d-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:55 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1b6259a9-e4f5-4d15-afca-bf3e9ee525de tempest-CinderUnicodeTest-44390450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.a9412466-b7ef-4e35-bd51-acecff42ad1f" returned: 0 in 0.522s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:55 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-1b6259a9-e4f5-4d15-afca-bf3e9ee525de tempest-CinderUnicodeTest-44390450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71e09e44-5499-4f4a-8ed8-3df18eb08902(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81957) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:01:55 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[38df3bd9-bb06-4797-98f6-0d10be35e37d]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:55 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1b6259a9-e4f5-4d15-afca-bf3e9ee525de tempest-CinderUnicodeTest-44390450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:55 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902 Apr 21 21:01:55 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:56 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1b6259a9-e4f5-4d15-afca-bf3e9ee525de tempest-CinderUnicodeTest-44390450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902" returned: 0 in 0.527s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1b6259a9-e4f5-4d15-afca-bf3e9ee525de tempest-CinderUnicodeTest-44390450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.a9412466-b7ef-4e35-bd51-acecff42ad1f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:56 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.a9412466-b7ef-4e35-bd51-acecff42ad1f Apr 21 21:01:56 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:56 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1b6259a9-e4f5-4d15-afca-bf3e9ee525de tempest-CinderUnicodeTest-44390450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.a9412466-b7ef-4e35-bd51-acecff42ad1f" returned: 0 in 0.419s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1b6259a9-e4f5-4d15-afca-bf3e9ee525de tempest-CinderUnicodeTest-44390450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.a9412466-b7ef-4e35-bd51-acecff42ad1f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:56 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.a9412466-b7ef-4e35-bd51-acecff42ad1f Apr 21 21:01:56 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:56 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:56 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-1b6259a9-e4f5-4d15-afca-bf3e9ee525de tempest-CinderUnicodeTest-44390450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902.a9412466-b7ef-4e35-bd51-acecff42ad1f" returned: 0 in 0.383s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:56 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1b6259a9-e4f5-4d15-afca-bf3e9ee525de tempest-CinderUnicodeTest-44390450 None] Lock "cinder-quobyte-a9412466-b7ef-4e35-bd51-acecff42ad1f" released by "_delete_snapshot" :: held 1.924s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:56 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1b6259a9-e4f5-4d15-afca-bf3e9ee525de tempest-CinderUnicodeTest-44390450 None] Lock "cinder-quobyte-71e09e44-5499-4f4a-8ed8-3df18eb08902" released by "delete_snapshot" :: held 1.941s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:57 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-1b6259a9-e4f5-4d15-afca-bf3e9ee525de tempest-CinderUnicodeTest-44390450 None] Created reservations ['58c0608c-530a-45c4-9fa0-b04daf45e5ef', 'a8292778-771f-46b5-b114-e01b82440ffd', '7aedecaa-a4fa-4a6a-8538-4046d1464e1c', '59135d26-c726-428e-a7b1-ab098406a7ae'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:57 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-1b6259a9-e4f5-4d15-afca-bf3e9ee525de tempest-CinderUnicodeTest-44390450 None] Delete snapshot completed successfully. Apr 21 21:01:57 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-1b6259a9-e4f5-4d15-afca-bf3e9ee525de tempest-CinderUnicodeTest-44390450 None] Lock "cinder-a9412466-b7ef-4e35-bd51-acecff42ad1f-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:57 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-aeefedff-db5e-4673-83a7-bd74ee8e829a tempest-CinderUnicodeTest-44390450 None] Acquiring lock "cinder-71e09e44-5499-4f4a-8ed8-3df18eb08902-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:57 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-aeefedff-db5e-4673-83a7-bd74ee8e829a tempest-CinderUnicodeTest-44390450 None] Lock "cinder-71e09e44-5499-4f4a-8ed8-3df18eb08902-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:57 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-aeefedff-db5e-4673-83a7-bd74ee8e829a tempest-CinderUnicodeTest-44390450 None] Acquiring lock "cinder-quobyte-71e09e44-5499-4f4a-8ed8-3df18eb08902" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:57 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-aeefedff-db5e-4673-83a7-bd74ee8e829a tempest-CinderUnicodeTest-44390450 None] Lock "cinder-quobyte-71e09e44-5499-4f4a-8ed8-3df18eb08902" acquired by "delete_volume" :: waited 0.011s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:57 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4101beb-6669-4d2a-9d99-0d50b10ccb15]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aeefedff-db5e-4673-83a7-bd74ee8e829a tempest-CinderUnicodeTest-44390450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:57 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902 Apr 21 21:01:57 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:57 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aeefedff-db5e-4673-83a7-bd74ee8e829a tempest-CinderUnicodeTest-44390450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902" returned: 0 in 0.445s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:57 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aeefedff-db5e-4673-83a7-bd74ee8e829a tempest-CinderUnicodeTest-44390450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:57 devstack sudo[90878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902 Apr 21 21:01:57 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:58 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aeefedff-db5e-4673-83a7-bd74ee8e829a tempest-CinderUnicodeTest-44390450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-71e09e44-5499-4f4a-8ed8-3df18eb08902" returned: 0 in 0.382s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-aeefedff-db5e-4673-83a7-bd74ee8e829a tempest-CinderUnicodeTest-44390450 None] Lock "cinder-quobyte-71e09e44-5499-4f4a-8ed8-3df18eb08902" released by "delete_volume" :: held 0.862s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:58 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:UPDATE=280,cinder:SELECT=225,cinder:DELETE=27,cinder:INSERT=69 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:01:58 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-aeefedff-db5e-4673-83a7-bd74ee8e829a tempest-CinderUnicodeTest-44390450 None] Created reservations ['7323e492-19c8-4c3b-aea3-5eb7b9b5dc6a', '5aaea080-8791-4399-b8b4-5056ea1059d7', 'c5d797ad-19d6-4954-9c8d-aca0813fcc91', 'a662c231-0142-4c5e-a8e3-7d5c50b2241f'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:58 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:SELECT=192,cinder:UPDATE=299,cinder:INSERT=70,cinder:DELETE=25 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:01:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-aeefedff-db5e-4673-83a7-bd74ee8e829a tempest-CinderUnicodeTest-44390450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-aeefedff-db5e-4673-83a7-bd74ee8e829a tempest-CinderUnicodeTest-44390450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-aeefedff-db5e-4673-83a7-bd74ee8e829a tempest-CinderUnicodeTest-44390450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:58 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-aeefedff-db5e-4673-83a7-bd74ee8e829a tempest-CinderUnicodeTest-44390450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-aeefedff-db5e-4673-83a7-bd74ee8e829a tempest-CinderUnicodeTest-44390450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aeefedff-db5e-4673-83a7-bd74ee8e829a tempest-CinderUnicodeTest-44390450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:58 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:58 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ccfe677f-eb17-40b7-939d-7ff70643091a tempest-CinderUnicodeTest-44390450 None] Acquiring lock "cinder-6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7-delete_volume" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ccfe677f-eb17-40b7-939d-7ff70643091a tempest-CinderUnicodeTest-44390450 None] Lock "cinder-6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ccfe677f-eb17-40b7-939d-7ff70643091a tempest-CinderUnicodeTest-44390450 None] Acquiring lock "cinder-quobyte-6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7" by "delete_volume" {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ccfe677f-eb17-40b7-939d-7ff70643091a tempest-CinderUnicodeTest-44390450 None] Lock "cinder-quobyte-6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7" acquired by "delete_volume" :: waited 0.009s {{(pid=81957) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:58 devstack cinder-volume[81957]: DEBUG oslo.privsep.daemon [-] privsep: reply[325c4336-defd-494d-904d-cba15bc20383]: (4, 'qcow2') {{(pid=82748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ccfe677f-eb17-40b7-939d-7ff70643091a tempest-CinderUnicodeTest-44390450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:58 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7 Apr 21 21:01:58 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:58 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-aeefedff-db5e-4673-83a7-bd74ee8e829a tempest-CinderUnicodeTest-44390450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.418s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:58 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-aeefedff-db5e-4673-83a7-bd74ee8e829a tempest-CinderUnicodeTest-44390450 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:58 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-aeefedff-db5e-4673-83a7-bd74ee8e829a tempest-CinderUnicodeTest-44390450 None] Deleted volume successfully. Apr 21 21:01:58 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-aeefedff-db5e-4673-83a7-bd74ee8e829a tempest-CinderUnicodeTest-44390450 None] Lock "cinder-71e09e44-5499-4f4a-8ed8-3df18eb08902-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:58 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ccfe677f-eb17-40b7-939d-7ff70643091a tempest-CinderUnicodeTest-44390450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7" returned: 0 in 0.480s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:58 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ccfe677f-eb17-40b7-939d-7ff70643091a tempest-CinderUnicodeTest-44390450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:58 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7 Apr 21 21:01:58 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:59 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ccfe677f-eb17-40b7-939d-7ff70643091a tempest-CinderUnicodeTest-44390450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499/volume-6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7" returned: 0 in 0.394s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:59 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ccfe677f-eb17-40b7-939d-7ff70643091a tempest-CinderUnicodeTest-44390450 None] Lock "cinder-quobyte-6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7" released by "delete_volume" :: held 0.903s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:59 devstack cinder-volume[81957]: DEBUG cinder.quota [None req-ccfe677f-eb17-40b7-939d-7ff70643091a tempest-CinderUnicodeTest-44390450 None] Created reservations ['d64b1017-c01f-4ab7-b5b0-742dff27f339', 'dd1fed3b-ac22-477f-b597-d09fb3bc864f', '4ba48720-e4cc-42dc-8817-f8fda8ee8f98', '10416307-07c9-42ec-ae94-d8ba2c1abdd0'] {{(pid=81957) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ccfe677f-eb17-40b7-939d-7ff70643091a tempest-CinderUnicodeTest-44390450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ccfe677f-eb17-40b7-939d-7ff70643091a tempest-CinderUnicodeTest-44390450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ccfe677f-eb17-40b7-939d-7ff70643091a tempest-CinderUnicodeTest-44390450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:59 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-ccfe677f-eb17-40b7-939d-7ff70643091a tempest-CinderUnicodeTest-44390450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1376c3b3-0235-43f3-b833-60d009f17fd7'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-ccfe677f-eb17-40b7-939d-7ff70643091a tempest-CinderUnicodeTest-44390450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ccfe677f-eb17-40b7-939d-7ff70643091a tempest-CinderUnicodeTest-44390450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:59 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499 Apr 21 21:01:59 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:59 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:59 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-ccfe677f-eb17-40b7-939d-7ff70643091a tempest-CinderUnicodeTest-44390450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a6c9bdec144b70b673296bcc391e499" returned: 0 in 0.432s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:59 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-ccfe677f-eb17-40b7-939d-7ff70643091a tempest-CinderUnicodeTest-44390450 None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:59 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-ccfe677f-eb17-40b7-939d-7ff70643091a tempest-CinderUnicodeTest-44390450 None] Deleted volume successfully. Apr 21 21:01:59 devstack cinder-volume[81957]: DEBUG cinder.coordination [None req-ccfe677f-eb17-40b7-939d-7ff70643091a tempest-CinderUnicodeTest-44390450 None] Lock "cinder-6e8806e5-e1fd-4d44-bdcc-4d810cf5a0e7-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=81957) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:09 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=7 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:02:09 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}